Big data is a marketing term that describes the large volume of data - both structured and unstructured - that inundates a business on a day-to-day basis.
How is my description different? Your description sounds like it comes from the marketing material for a product. Are you saying it must involve unstructured data to be big data? Are you saying that a small business can't have big data because they don't meet your volume of data? Are you saying that a smart phone can't possibly have big data? Would a vendor ever tell a customer they don't have big data because they don't meet your requirements? Hadoop is one of many big data products. Every company defines big data that puts their products into the best light possible. The solution to big data problems depends upon the actual bottleneck and Hadoop may not actually solve that customers issues (e.g. not enough hardware or thrashing on a single disk). You say a lot of big data is unstructured. Very true because many big data products will only solve structured data problems and are not intended to be used with unstructured data. Because there are many possible bottlenecks and many possible hardware / software solutions, a big data specialist can help determine how to solve your big data problem. This is how people like Cheryl Watson made their living. Regards, Jon. On Monday, January 22, 2018 4:25 PM, Ze'ev Atlas <[email protected]> wrote: Big data is not what you have described. It is enormous amount of data that you want to access, analyze and get results in reasonable time. Reading it in VSAM records is obviously better than teading a stream, but reading 1,000,000,000,000 records takes a lot of time in HLASM, COBOL, or C. Resolving the big data isdues in platforms like Hadoop rely on parallel processing. That could be done in any of the sformentioned languges providing the right design.Moreover, a lot of big data is unstructured and cannot easily be transformed to unified recordsZe'ev
