For the following scenario, please determine which one of the “Big Data” tools (

Question

For the following scenario, please determine which one of the “Big Data” tools (Apache and Hadoop) you would use and explain how you would use it, including which capabilities of the tool proposed you would take advantage of:

You are creating an ETL (Extract, Transform and Load) from a bank records database. This database has a defined schema of multiple tables and needs to be converted just once before migrating to a new system. The source RDBMS is a PostgreSQL server and is located on a single high-performance server.

Explanation / Answer

I'd choose Apache spark. Apache Spark speeds up batch processing of huge amount of data by using in-memory computation and procession optimization. This would allow us to process huge back data in short amount of time.

Another salient feature it can process real-time data which is really helpful in this case as industries like bank sector do work with lots of real time data. It is also really easy to use. It comes with user-friendly APIs for several languages.

Related Questions

Navigate

• Browse (All)
• Browse F
• Subjects

Integrity-first tutoring: explanations and feedback only — we do not complete graded work. Learn more.