> business - Vinova - Page 10

What is Hadoop? (from Interview with Amr Awadallah – Cloudera CTO)

by | 22 Feb 2010 | business, Technologies, Trends

First, it’s worth making the important clarifying point that Hadoop is not a database. Hadoop is a data processing system, and in fact, I would even go as far as saying Hadoop is an operating system. The core of an operating system boils down to a file system, the storage of files, and a process scheduling system that runs applications on top of these files. There are many other components that help with devices, credentials and user access, and so on, but that is the core. Hadoop is exactly the same thing. The core of Hadoop is the Hadoop Distributed File System, which is a file system that’s runs across many nodes. It links together the file systems on many local nodes to make them into one big file system. Hadoop MapReduce is really the job scheduling system that takes care of scheduling jobs on top of all those nodes. That is the key distinction between Hadoop’s approach and that of database systems. Hadoop, at its heart, does not require any structure to your data. You can just upload files directly from anywhere, like a web server, RFID device, or cell phone mobile device, directly into Hadoop. They could be images, videos, or just a bunch of bits. They don’t have to have a schema with column types and so on, which gives you tremendous agility and flexibility. Hadoop has a very nice model that I sometimes refer to as schema on read. Whereas defining your schema as you’re writing the data in limits what you can put in by requiring it to be conformant to the schema that...
Malcare WordPress Security

ios app development singapore,singapore web design,app development singapore,website developer singapore,website development singapore,singapore web design services,app developer singapore,design agency singapore,mobile apps development singapore,developer in singapore,web application singapore,singapore mobile app developer,mobile application development singapore,ruby on rails developer singapore,ios developer singapore,singapore mobile application developer,web development company singapore,web design services singapore,singapore app developer,website designer singapore,mobile app developer singapore,android developer singapore,graphic designer in singapore,mobile apps singapore,mobile app development singapore,web designer singapore,design firms in singapore,mobile application developer singapore,developers in singapore,web development singapore,website design singapore,singapore web development,web design company singapore,mobile game developer singapore,web design singapore,mobile developer singapore,singapore website design