📄️ Project Structure
A DataSQRL project is structured as follows where is the project name.
📄️ Enriching Data Streams
A common requirement in stream processing is to enrich a STREAM of events with dimensional data in a time-consistent manner.
📄️ Subgraph Elimination
Sometimes the Flink optimizer is too smart for its own good and will push down predicates that make common subgraph identification impossible resulting in duplicate computation.
📄️ Templating
DataSQRL uses the Mustache templating engine to substitute configuration variables in SQRL scripts, making them reusable and configurable without modifying the code.
📄️ Testing Authorization
You can test record filtering, data masking, and other types of authorization based data access control with DataSQRL's automated test runner via the test command.
📄️ Testing
DataSQRL's automated test runner can execute two types of snapshot test via the run command: