Jai's Blog

Referred Link - https://www.linkedin.com/feed/update/urn:li:activity:6960116635974168576/

The article explains the structure of general #Big #Data pipelines in a very clear and easy to understand way. Recommended to any #Data #Engineer - working in a cloud environment or not.

Navigating the complexities of data pipelines across these platforms unveils a spectrum of unique functionalities and innovations. Each platform excels in key phases: ingestion, data lakes, processing, data warehousing, and presentation.

Here’s a comprehensive guide to get you started:

𝗜𝗻𝗴𝗲𝘀𝘁𝗶𝗼𝗻
🔹 Azure: Azure IoT Hub, Azure Function, Event Hub, Data Factory
🔹 AWS: AWS IoT, Lambda Function, Kinesis Streams/Firehose, Data Pipeline
🔹 GCP: Cloud IoT, Cloud Function, PubSub, Dataflow

𝗗𝗮𝘁𝗮 𝗟𝗮𝗸𝗲
🔹 Azure: Azure Data Lake Store
🔹 AWS: Glacier, S3 Lake Formation
🔹 GCP: Cloud Storage, BigQuery Omni, Preparation & Computation
🔹 Azure: Databricks, Data Explorer, Azure ML

𝗦𝘁𝗿𝗲𝗮𝗺 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀
🔹 AWS: EMR, Glue ETL, Sage Maker Kinesis Analytics
🔹 GCP: DataPrep, DataProc, DataFlow, AutoML, Dataprep by Trifacta

𝗗𝗮𝘁𝗮 𝗪𝗮𝗿𝗲𝗵𝗼𝘂𝘀𝗶𝗻𝗴
🔹 Azure: Cosmos DB, Azure SQL, Azure Redis Cache, Data Catalog, Event Hub Synapse Analytics
🔹 AWS: RedShift, RDS, Elastic Search, DynamoDB, Glue Catalog, Kinesis Streams
🔹 GCP: Cloud Datastore, Bigtable, Cloud SQL, BigQuery, Memory Store, Data Catalog, PubSub

𝗣𝗿𝗲𝘀𝗲𝗻𝘁𝗮𝘁𝗶𝗼𝗻
🔹 Azure: Azure ML Designer/Studio (EDA), Power BI, Azure Function
🔹 AWS: Athena (EDA), QuickSight, Lambda Function
🔹 GCP: Colab (EDA), Datalab Data Studio, Cloud Function

Each platform tailors its approach to accommodate the entire lifecycle of data, from initial collection to insightful visualizations that drive business strategies.

Whether it’s the comprehensive analytics solutions of Azure, the scalable and customizable nature of AWS, or the real-time, user-friendly interfaces of GCP, the choice depends on your specific needs, budget, and tech stack.

Source - https://www.linkedin.com/feed/update/urn:li:activity:6954998136025034752/

How do you pay from your digital wallet, such as Paytm, Paypal and Venmo, by scanning the QR code?

To understand the process involved, we need to divide the “scan to pay” process into two sub-processes:
1. Merchant generates a QR code and displays it on the screen
2. Consumer scans the QR code and pays

Here are the steps for generating the QR code:
1. When you want to pay for your shopping, the cashier tallies up all the goods and calculates the total amount due, for example, $123.45. The checkout has an order ID of SN129803. The cashier clicks the “checkout” button.
2. The cashier’s computer sends the order ID and the amount to PSP.
3. The PSP saves this information to the database and generates a QR code URL.
4. PSP’s Payment Gateway service reads the QR code URL.
5. The payment gateway returns the QR code URL to the merchant’s computer.
6. The merchant’s computer sends the QR code URL (or image) to the checkout counter.
7. The checkout counter displays the QR code.

These 7 steps complete in less than a second. Now it’s the consumer’s turn to pay from their digital wallet by scanning the QR code:
1. The consumer opens their digital wallet app to scan the QR code.
2. After confirming the amount is correct, the client clicks the “pay” button.
3. The digital wallet App notifies the PSP that the consumer has paid the given QR code.
4. The PSP payment gateway marks this QR code as paid and returns a success message to the consumer’s digital wallet App.
5. The PSP payment gateway notifies the merchant that the consumer has paid the given QR code.

Source: blog.bytebytego.com
Credit : Alex xu

Disclaimer : (This post has been shared only for technology education & knowledge sharing purpose. Image & Info has been taken from above mentioned source and credited to the author. There is no endorsement of any products or service.)

Keep learning 📚 and keep growing 📈

🤝 Follow me for the latest about cybersecurity

Total Posts

Search this Site

Connect with Me

Translate Articles

Total Pageviews

Contributors

My Achievements

My Favorite Links

Contact Form

Blog Archive

Recent Posts

Followers

Report Abuse

Popular Posts

Comments