Johan LouwersSolved — Apache Spark "driverState": "FAILED" when using REST APIRecently I encountered a continuos error when submitting a new job to Apache Sprak via the REST API. All jobs submissions happen…·3 min read·Apr 28, 2024----
Johan LouwersHow to locally submit Apache Spark jobs explainedOnce you’ve set up your Apache Spark cluster and crafted the logic you wish to execute, the next natural step is to submit your job to the…·16 min read·Apr 18, 2024----
Johan LouwersEnable Apache Spark REST API on Oracle Cloud based Linux VMsApache Spark is a powerful, open-source, distributed computing system that has rapidly become a cornerstone in big data processing and…·2 min read·Apr 18, 2024----
Johan LouwersAutomate deploying Apache Spark on Oracle Cloud InfrastructureWhen working with Apache Spark, you may often require rapid development environments. Solutions akin to Vagrant are excellent for…·4 min read·Apr 16, 2024----
Johan LouwersTricking the Nasdaq API to talk to your python code in JSONWhen people need to download ticker symbols from Nasdaq, many will attempt to access the api.nasdaq.com API endpoint. For instance, making…·2 min read·Apr 16, 2024----
Johan LouwersNATO AWACS public flight data analyse with PythonDisclaimer; this blogpost has been written based upon public available information only.·6 min read·Apr 15, 2024----
Johan LouwersKNMI derived temperature with Inverse Distance Weighting in Oracle SQLIn this article we will build upon an earlier post where we outlined how you can calculate the distance between geographical coordinates…·6 min read·Apr 11, 2024----
Johan LouwersHaversine formula in Oracle SQLWhen calculating the distance between two point on earth you have choice between Haversine and Vincenty. The Haversine and Vincenty…·5 min read·Apr 5, 2024----
Johan LouwersRoyal Netherlands Meteorological Institute MQTT observation dataThe Royal Netherlands Meteorological Institute (KNMI) serves as the primary scientific authority for meteorological research in the…·5 min read·Apr 4, 2024----
Johan LouwersData Mesh — REST API RoutingWhen developing multiple data products and wanting to expose them to the users in a logical and ordered manner, it being either internal…·7 min read·Apr 2, 2024----