BIG DATA – Really a “Big” Challenge.

Big data itself defines that it is related to the very large data. Any fact or figure is known as data. Here big data defines the large amount of fact or figures. The data is so large and complex to handle that’s why known as big data. Different tools (data management tools) which are used to handle the data seems useless in front of large amount of data .The main challenges because of large amount of data includes capture, curation, storage, search, sharing, transfer, analysing and visualization. Some limitations also occurs due to this large amount of data set such as internet search, finance etc.

It becomes very difficult to work on the large amount of data with previous methods such as relational database management system.

The term big data vary from one organization to another on the basis of capabilities of the organization over handling or managing the data set. For some organization hundreds of terabytes may have not affects but for some hundreds of gigabytes may cause trouble. Big data includes data set beyond the capacity of data storage which causes trouble further.

Now the size of big data moves from some terabytes to petabytes of data in a single data set. It is a kind of unstructured data as the data is not in structures form so unwanted data is also available in the data set which enhance the size of data set. Some standard data handling techniques like database management system, relational database management system, Object relational database management system are not capable of handling this kind of unstructured data.

Big data requires an effective new technology to handle this kind of hurdles and capable of managing large quantities of data on time. New technologies which are suggested for big data includes MPP(Massive Parallel processing), data mining grids, search based applications, distributed databases, cloud based infrastructure and the internet.