Big Data provides the foundation for processing unstructured information. The ability to process unstructured information results in finding out trends and patterns that can then be further analyzed. This is important since the foundation of data analytics and predictive analysis is the ability to obtain relevant information out of the mountains of unstructured data. In addition, there should be an emphasis on service integration and interoperability to include relational data, unstructured data and other data sources.
Open Data initiatives should be based on strong foundations of technologies such as Shared Services, Big Data and Cloud. There are initiatives underway related to open data that drive the development and deployment of innovative applications. Making data accessible enables the development of new products and services. This data should be made available in a standardized manner so that developers can utilize it quickly and effectively. Open data maximizes value creation built on the existing structured and unstructured data. Open Data strategy and initiatives should define specific requirements of what data will be made available based on the utility of that information.
Big Data processing and analysis drives enhanced decision making such as in the areas of complex real time analytics, discovery of patterns and business intelligence. Frameworks such as Hadoop support distributed processing of large data sets and vendors are providing connectors to support Big Data, Cloud management and in memory computing to reduce data aggregation and maintenance time. Big Data analytics facilitates advanced analytics and Open Data facilitates greater transparency.
Making specific and “relevant” information available, while protecting security and privacy is the next level of data sharing.
The key here is “relevance”.
Just providing massive dumps of data that are hard to use is not the solution.
The data that is obtained should support automated processing to develop custom applications and can be rendered as html, xml etc. This can promote greater number of not just traditional applications, but also mobile applications. There has to be great emphasis on security and privacy since any errors can compromise important information when the data vaults are opened.
(This has been extracted from and is reference to Ajay Budhraja’s blog. All views and information expressed here are solely Ajay’s views, and do not represent the positions and views of anyone else, any organization or any government agency).
Image courtesy of KROMKRATHOG at FreeDigitalPhotos.net