A layer that will work as an ingestion layer, specifically for big data workloads, in this way we could move data from any external data source to our staging area, in this case we will use an Apache Spark cluster using Google Cloud Dataproc.Chosen Infrastructure: Google Cloud PlatformĪlthough the library was built to accept any type cloud provider or on-premise infrastructures, in this case we will use Google Cloud Platform as the cloud provider, we will create three layers: The tool should display and assign status to tasks at runtime. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |