This is an Azure Stream Analytics project that ingests real-time weather data from a python web scraper and outputs the data to Azure Data Lake Storage Gen 2.
The python web scraper application extracts weather information from the web and outputs the data to Azure Event Hub. Azure Event Hub in turn sends this data to Azure Stream Analytics as an input stream. Azure Stream Analytics uses a T-SQL query to select the data from the input stream and to write it to an output stream. In this case the output stream is Azure Data Lake Storage Gen 2.
Weather data scraped from free weather website: URL: https://weather.com/weather/today/l/USNY0996:1:US
We use cookies to analyze website traffic and optimize your website experience. By accepting our use of cookies, your data will be aggregated with all other user data.