> business - Vinova - Page 10

What is Hadoop? (from Interview with Amr Awadallah – Cloudera CTO)

by | 22 Feb 2010 | business, Technologies, Trends

First, it’s worth making the important clarifying point that Hadoop is not a database. Hadoop is a data processing system, and in fact, I would even go as far as saying Hadoop is an operating system. The core of an operating system boils down to a file system, the storage of files, and a process scheduling system that runs applications on top of these files. There are many other components that help with devices, credentials and user access, and so on, but that is the core. Hadoop is exactly the same thing. The core of Hadoop is the Hadoop Distributed File System, which is a file system that’s runs across many nodes. It links together the file systems on many local nodes to make them into one big file system. Hadoop MapReduce is really the job scheduling system that takes care of scheduling jobs on top of all those nodes. That is the key distinction between Hadoop’s approach and that of database systems. Hadoop, at its heart, does not require any structure to your data. You can just upload files directly from anywhere, like a web server, RFID device, or cell phone mobile device, directly into Hadoop. They could be images, videos, or just a bunch of bits. They don’t have to have a schema with column types and so on, which gives you tremendous agility and flexibility. Hadoop has a very nice model that I sometimes refer to as schema on read. Whereas defining your schema as you’re writing the data in limits what you can put in by requiring it to be conformant to the schema that...
Malcare WordPress Security

website designer singapore,ios app development singapore,ruby on rails developer singapore,developers in singapore,web development singapore,web application singapore,mobile app developer singapore,mobile apps development singapore,android developer singapore,graphic designer in singapore,web design services singapore,singapore web development,design firms in singapore,app development singapore,web development company singapore,website development singapore,singapore web design,ios developer singapore,singapore web design services,developer in singapore,singapore app developer,mobile apps singapore,web design company singapore,singapore mobile app developer,singapore mobile application developer,web design singapore,mobile developer singapore,mobile app development singapore,mobile game developer singapore,mobile application developer singapore,design agency singapore,app developer singapore,mobile application development singapore,singapore website design,web designer singapore,website design singapore,website developer singapore