Write any received data to the console
#Download spark 2.3.3 for windows code
Next, open the Program.cs file and replace the code with the one listed below. dotnet add package Microsoft.Spark -version 0.4.0 Once it created the new folder with the related project files, change into it and add the Microsoft.Spark package by entering the following. Having prepared your test environment, you are now ready to create a new dotnet core project using the following command in your cmd window or shell: dotnet new console -o ActiveMqTest Keeping that in mind, you can either download Apache Spark 2.3.3 directly from the download page, or just use my Linux docker image tagged with 0.4.0-spark-2.3.3-linux. NET for Apache Streaming, on either Windows, or Linux.Īpache Bahir, which I use for MQTT Streaming into Spark, is currently available in version 2.3.3 and only works with Apache Spark of the same version. NET for Apache Spark for MQTT Streamingįor the most parts, you can follow this quick intro tutorial, which walks you through the process of installing.
The data itself was generated by IanniX and forwarded to ActiveMQ utilizing my osc2activemq docker image. If you followed my series about a real-time data processing pipeline, you probably remember that I have used Apache Bahir to retrieve streaming data from Apache ActiveMQ via the MQTT protocol. Therefore, it is now time to test, if it can be used for MQTT Streaming as well.
NET for Apache Spark 0.4.0 was released recently.
0 kommentar(er)
