Important topics to relearn
- Query optimizer
- Vaccum
- Shallow Clone, Deep Clone
- Predictions using MLFlow
- apply spark udf functions
- Stream-Stream Joins
- Auto- Loader
- trigger syntax
- structure streaming syntax, wth auto loader, trigger see all the examples
- Database accesses. syntax
- use of location keyword
- OPTIMIZE
- trigger(availableNow=True)
- Spark UDF
- Auto Optimize
- Stream-Stream Joins
- Stream-Static joins
- Window and Watermark
- foreachbatch (for non time based window operation)