Maritime noon report with Google Cloud Dataprep

This was a very interesting project that I worked on, the use case for the project was to make the maritime noon report data available in Google BigQuery, sounds simple enough. However there were a lot of requirements, from collecting application data from the Greenpeace fleet in different formats leveraging Cloud Functions and API calls, landing the data in Cloud Storage, normalizing the data for reporting and translating each different ships’ schemas into one common schema in BigQuery thanks to Google Cloud Dataprep by Trifacta, and finally automating the end to end…