The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the category “SQL Developer Data Modeler”

New Version of SQL Developer Data Modeler is available!

It is now version 17.2!

Don’t worry, you have not missed 13+ releases!

A new versioning number system has been put in place and applies to both SQL Developer and SQL Developer Data Modeler (SDDM). A new version will come out about four times a year and the version number is created using the last two digits of the year and the number of the quarter.

So version 17.2 = Q2 2017

Data Modeler

You can get the newest version here:

http://www.oracle.com/technetwork/developer-tools/datamodeler/overview/index.html

SQL Developer

There is also a new version (17.2) for this tool as well. Get it here:

http://www.oracle.com/technetwork/developer-tools/sql-developer/overview/index.html

Download and have fun!

Kent

The Data Warrior

Early Christmas: The New #SQLDev Data Modeler is Here!

Thanks to the gang at Oracle for an early Christmas present – the newest version of Oracle SQL Developer Data Modeler (SDDM) is ready for download and use.

The best FREE data modeling tool on the planet just got better!

To be clear this is Early Adopter (EA) version 2 of SDDM 4.2. You can get it here right now!

#SQLDev Data Modeler New Features

Of course there are some bug fixes from EA1, but also some new features for you to enjoy:

Import from Oracle Database

  •   performance and filtering enhancements
  •   ability to define Oracle Client for thick connections
  •   view and materialized view driving query and columns now parsed and validated

Versioning

  •   improvements in performance
  •   new models are shown as a single node in pending changes window

Reporting

  • PDF reports allow diagrams to be embedded with links from diagram to details part into report
  • HTML report for tables now include diagrams

 

SQL Developer Data Modeler EA2 adds diagrams to HTML reports

#SQLDev Data Modeler HTML report with diagrams embedded

So go download and unwrap that present!

Cheers!

Kent

The Data Warrior

P.S. If you need training on Oracle Data Modeler, be sure to check out my online video training course along with my tips and tricks ebook. (HINT: Buy them now, and you may be able to deduct the cost from your 2016 taxes as an educational expense.)

Adventures in the Cloud

I just got back from a whirlwind tour that included a trip to San Francisco to visit the Snowflake HQ, attend the annual Oracle ACE Directors briefing, meetings and events at Oracle OpenWorld (OOW), speaking at OakTable World (OTW), then off to Chicago to speak at Enterprise Dataversity.

Yes it was packed. And lots of talk about cloud everything!

 

Thanks to the great folks at OTN (Roland and Jennifer) for hosting us again this year at Oracle HQ.

Here are a few highlights:

Morning Chi Gung

Now an annual event is doing Chi Gung by the lake behind the Sofitel with a few ACE Director friends before the *top secret* briefing.

morning-chigung

 

Pre-OOW Athletics

Well, sort of. This year I walked the Golden Gate Bridge (5K) and took a dip in SF Bay in the 5th Annual Swim The Bay. Proud to say I have attended all 5 years of that event.

Nothing like a brisk morning walk to start the day!

Nothing like a brisk morning walk to start the day!

 

Then there is the brisk swim!

Then there is the brisk swim!

And this year, I got a pretty good size group to do Chi Gung on the beach after the swim (to warm ourselves back up!)

Time to get that chi flowing after the swim!

Time to get that chi flowing after the swim!

OTW 2016

I think this is the 3rd time I have presented at the un-conference run in parallel to OOW. But this year was the 1st time I did it as an Oaktable member! Gave my talk on Building a Virtualized ODS using SQL Developer Data Modeler.

No picture from that talk (sorry) but I did a very short Chi Gung set with the attendees at lunch time to get them moving out of their seats.

 

OTN Interview

This was the best part – getting to do an interview with my good friend Laura Ramsey from OTN about data modeling and data warehousing in the cloud. Check out my full interview here.

otninterviewoow16

Live cast interview from the Moscone at OOW 2016

 

The Drake Hotel

For the Dataversity event in Chicago, I got to stay at the very classy Drake Hotel right on the lake shore with a great view.

Awesome View!

Awesome View!

thedrake

Oh, and my talk on Data Warehousing in 2016 and Beyond went great. I learned a lot in the various keynotes and even got an introduction to Data Science.

 

Well that is my little update for now.

Check my speaking page to see where I will be next!

Ciao.

Kent

The Data Warrior

 

 

 

Better Data Modeling: Customizing Oracle Sql Developer Data Modeler (#SQLDevModeler) to Support Custom Data Types

On a recent customer call (for Snowflake), the data architects were asking if Snowflake provided a data model diagramming tool to design and generate data warehouse tables or to view a data model of an existing Snowflake data warehouse. Or if we knew of any that would work with Snowflake.

Well, we do not provide one of our own – our service is the Snowflake Elastic Data Warehouse (#ElasticDW).

The good news is that there are data modeling tools in the broader ecosystem that you can of course use (since we are ANSI SQL compliant).

If you have read my previous posts on using JSON within the Snowflake, you also know that we have a new data type called VARIANT for storing semi structured data like JSON, AVRO, and XML.

In this post I will bring it together and show you the steps to customize SDDM to allow you to model and generate table DDL that contain columns that use the VARIANT data type.

Read the details of how I did it here on my Snowflake blog:

Snowflake SQL: Customizing Oracle Sql Developer Data Modeler (SDDM) to Support Snowflake VARIANT – Snowflake

Enjoy!

Kent

The Data Warrior

P.S. If you are in Austin, Texas this weekend, I will be speaking at Data Day Texas (#DDTX16). Snowflake will have a booth there too, so come on by and say howdy!

Better Data Modeling: Discovering Foreign Keys (FK) in #SQLDevModeler (SDDM)

A while back I had an interesting situation when I was attempting to reverse engineer and document a database for a client.

I had a 3rd party database that had PKs defined on every table but no FKs in the database. The question I posed (on the Data Modeler Forum) was:

How do I get the FK Discover utility to find FK columns with this type of pattern:

Parent PK column = TABCUSTNUM

Child FK column = ABCCUSTNUM

So the root column name (CUSTNUM) is standard but in every table the column name has a different 3 character “prefix” that is effectively the table short name. Is there way to get the utility to ignore the first three characters of the column names?

This was in SDDM 4.1.873.

No easy answer.

Well, the ever helpful Philip was very kind and wrote me a slick custom Transformation Script that did the trick! (Check the post if you want to see the code.)

But wait there’s more!

In his response he mentioned a feature coming in 4.1.888 – the ability to include a table prefix as part of a FK column naming template (just like this app had done).

Cool, I thought, but how does that help?

Well with the template in place it turns out that you can have the FK Discovery utility search based on the Naming Template model rather than just look for exact matching column names.

Using the Custom Naming Template

So recently (today in fact) I was trying to add FKs to the Snowflake DB model I reverse engineered a few weeks back (Jeff pointed out they were missing). I noticed the model had that pattern of a prefix on both the FK and PK column names.

In the CUSTOMER table the PK is C_CUSTKEY. In the ORDER table it is O_CUSTKEY. Nice simple pattern (see the diagram below for more). That reminded me of the previous issue and Philip’s script.

Snowflake Schema

Off to OTN to find that discussion and refresh my memory.

In the post, Philip has posted an example of a template that fit my previous problem:

{table abbr}SUBSTR(4,30,FRONT,{ref column})

With the note that {table abbr} would be the equivalent of what I called the table prefix. So first I went to the table properties and put in the prefixes using the Abbreviation property:

Add Table Abbrev

Then all I had to do was modify his example to account for the underscore and the fact that the main column text would start at character #3 instead of #4:

{table abbr}_SUBSTR(3,30,FRONT,{ref column})

I input that by going to Properties -> Settings -> Naming Standards -> Templates and then editing the default template:

Set up FK template

Discover FKs!

Now it was just a matter of running the utility. You find that with a right mouse click on the Relational Design node:

Discover FK tool

Next you get the list of candidate FKs:

Create FKs

Note that the utility also suggested some FKs based on the unique constraints (UKs) as well. I did not want those, so I unchecked them before I hit “OK”.

The result was getting all the FKs I wanted added into my model! Viola!

Snowflake with RI

So I can happily report that Philip’s little enhancement works just fine in 4.1.3. WooHoo! I can see this being very useful for a lots of cases in the future.

In a future post (early next year), I will continue with showing how we implemented Referential Integrity constraints in Snowflake DB and if I can generate the DDL from #SQLDevModeler.

Happy New Year Y’all

Kent

The Data Warrior & Snowflake Technical Evangelist

Post Navigation

%d bloggers like this: