> business - Vinova - Page 10

What is Hadoop? (from Interview with Amr Awadallah – Cloudera CTO)

by | 22 Feb 2010 | business, Technologies, Trends

First, it’s worth making the important clarifying point that Hadoop is not a database. Hadoop is a data processing system, and in fact, I would even go as far as saying Hadoop is an operating system. The core of an operating system boils down to a file system, the storage of files, and a process scheduling system that runs applications on top of these files. There are many other components that help with devices, credentials and user access, and so on, but that is the core. Hadoop is exactly the same thing. The core of Hadoop is the Hadoop Distributed File System, which is a file system that’s runs across many nodes. It links together the file systems on many local nodes to make them into one big file system. Hadoop MapReduce is really the job scheduling system that takes care of scheduling jobs on top of all those nodes. That is the key distinction between Hadoop’s approach and that of database systems. Hadoop, at its heart, does not require any structure to your data. You can just upload files directly from anywhere, like a web server, RFID device, or cell phone mobile device, directly into Hadoop. They could be images, videos, or just a bunch of bits. They don’t have to have a schema with column types and so on, which gives you tremendous agility and flexibility. Hadoop has a very nice model that I sometimes refer to as schema on read. Whereas defining your schema as you’re writing the data in limits what you can put in by requiring it to be conformant to the schema that...
Malcare WordPress Security

singapore web development,website development singapore,website designer singapore,mobile game developer singapore,web development singapore,singapore web design,web design services singapore,web application singapore,app development singapore,ruby on rails developer singapore,mobile app development singapore,mobile application developer singapore,web design company singapore,developer in singapore,web development company singapore,singapore app developer,ios app development singapore,web design singapore,singapore web design services,singapore mobile app developer,mobile apps singapore,ios developer singapore,mobile apps development singapore,design agency singapore,developers in singapore,singapore website design,design firms in singapore,website design singapore,singapore mobile application developer,web designer singapore,mobile application development singapore,mobile developer singapore,graphic designer in singapore,android developer singapore,website developer singapore,mobile app developer singapore,app developer singapore