Building a star schema in SDP? Use identity columns with Streaming Tables!
Reddit r/databricks1w4 min read
Use identity columns in SDP Spark Declarative Pipelines' streaming tables now support identity columns -- this is particularly useful if you're building an SCD Type 1 or SCD Type 2 dimension table with AUTO CDC. Get faster joins and auto-incrementing surrogate keys natively within SDP today! Docs here %20%5D)! submitted by /u/minibrickster [link] [comments]
