Skip to main content

Concept of Big data

By
Best Laptop for students

Concept of BIG DATA

The concept of big data arrived in executive suites via IT and engineering departments, and those technical roots have led to some disagreement of what the term means. At its core, big data refers to high volumes of information from multiple sources being fed into data stores on a time-sensitive basis. The shorthand: lots of data coming rapidly and from many places. Big data is an important foundation of quality business intelligence, providing enough information to detect meaningful trends.

 Big Data Everywhere! 
•Lots of data is being collected
and warehoused
•Web data, e-commerce
•purchases at department/
grocery stores
•Bank/Credit Card
transactions

•Social Network
Type of Data

•Relational Data (Tables/Transaction/Legacy Data)
•Text Data (Web)
•Semi-structured Data (XML)
•Graph Data
•Social Network, Semantic Web (RDF), …
•Streaming Data
•You can only scan the data once
How much data?

•Google processes 20 PB a day (2008)
•Wayback Machine has 3 PB + 100 TB/month (3/2009)
•Facebook has 2.5 PB of user data + 15 TB/day (4/2009)
•eBay has 6.5 PB of user data + 50 TB/day (5/2009)
•CERN’s Large Hydron Collider (LHC) generates 15 PB a year


Technologies use for



Big Data Processing

HADOOP DISTRIBUTIONS


Hadoop is an open-source software framework for storing and processing big data in a distributed fashion on large clusters of commodity hardware. Essentially, it accomplishes two tasks: massive data storage and faster processing.

NOSQL DATABASES

A NoSQL database provides a way to store and retrieve data that is modelled in means other than the tabular relations used in relational databases. The data structures used by NoSQL databases (ex: key-value, graph, or document) differ from those used in relational databases, making some operations faster in NoSQL and others faster in relational databases. NoSQL databases are increasingly used in big data and real-time web applications.

Comments

Post a Comment

Popular posts from this blog

O Level Practical Queestion Paper (MS-OFFICE, MSDOS, MS-EXCEL, ICT Resources)

By
MSDOS 1. Write command to display all files having extension ‘jpg’. 2. Write command to display all files of all types starting with letter ‘m’. 3. Write command to display all files having names up to ten characters with second last letter as ‘n’, e.g. intelligent. 4. Write a command to copy the file mars of type exe from the directory ‘space’ of drive U to another directory “universe” in drive S. 5. Write a command to delete the directory as well as the files of the directory ‘world’ on drive E. 6. Write command to display all file names on the disk in drive A and having an extension of no more than two characters.   7. Write command to copy all the files beginning with ‘m’ and whose file names has a ‘txt’ extension from drive A to the ‘\document’ directory on drive C. 8. Write set of commands to create a subdirectory of the root directory called ‘exercise’, and then move into it 9. Perform the following tasks using DOS commands in the DOS sh...
Post a Comment
Read more

Learn Programming in UNIX

By
Q: - Write a program to input two numbers and add them?             gedit add.sh             clear             echo “enter two numbers:”             read a             read b             sum=`expr$a+$b`             echo $sum Syntax for if-else:- (1)          if test condition             then                 ---------                 --...
Post a Comment
Read more

IICS College 15th August Celebration Day

By
IICS COLLEGE  15th August Celebration Day
3 comments
Read more