Throughout the week, I read a lot of blog-posts, articles, and so forth, that has to do with things that interest me:
- data science
- data in general
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog-post is the “roundup” of the things that have been most interesting to me, for the week just ending.
Streaming
- Local testing with live data means faster development with Azure Stream Analytics. An Azure Stream Analytics (ASA) announcement of a new feature which lets you test your ASA queries locally while using live data streams from cloud sources such as Azure Event Hubs, IoT Hub or Blob storage!
- ATM Fraud Detection with Apache Kafka and KSQL. A blog post by Robin Moffat discussing how, by using Kafka and KSQL, you can take a stream of inbound ATM transactions and easily set up an application to detect transactions that look fraudulent. Awesome!
- Noria: dynamic, partially-stateful data-flow for high-performance web applications. Adrian dissects a white-paper about Noria: a new streaming data-flow system designed to act as a fast storage backend for read-heavy web applications. It acts like a database but precomputes and caches relational query results so that reads are blazingly fast.
Distributed Computing
- The FuzzyLog: a partially ordered shared log. Another white-paper dissected by Adrian. This time it is about FuzzyLog and the FuzzyLog abstraction which extends the shared log approach to partial orders, allowing applications to scale linearly without sacrificing transactional guarantees, and switch seamlessly between these guarantees when the network partitions and heals.
WIND (What Is Niels Doing)
I am still trying to get to grips with SQL Server 2019 Big Data Cluster, and now I better sort it out as I on Wednesday (November 7), is supposed to give a presentation about Building a SQL 2019 Big Data Cluster on Azure Kubernetes Service. If you are in Durban, please come by and say Hi!
~ Finally
That’s all for this week. I hope you enjoy what I did put together. If you have ideas for what to cover, please comment on this post or ping me.