Government, Digitisation, And The Big Data Issues.
The Government of a country is generally a system that has to supervise, regulate and manage plenty of endeavours. Managing the economy, external relations, administrating different states, readjusting to the dynamical world, foreign trades, framing laws, education, healthcare are some of the responsibilities of the government.
The world is observing a boom in emerging engineerings and technologies, all this is leading us to adapt to the digital environment. The business giants are adopting this change and fee very comfortably doing hectic tasks in just a few minutes or maybe seconds. For instance, the use of e-mails instead of letters or fax. Furthermore The govt. bodies are being attracted to the Digital Revolution. Taking an example from the DEMONETIZATION period of November 2016 India, numerous digital wallets and banking applications emerged at that point of time, govt. also took an initiative and launched its own application — BHIM UPI. Aadhar cards, Pan Cards, Voter Ids, Driving License, The Fine Payments, Tax payments, all this has switched from those thick register and pen entries to online mode.
Maintaining and Managing such huge records by taking the help of computers, appeared very easy to the non-technical employees, or those who just had to get and put the records, and surely it was, searching an old record is a very challenging job when it comes to the traditional pen-paper way. India is a country with a humongous count of citizens, overseeing the data entries of more than a hundred crore population came out to be a problem of storage. This leads us to the first problem in the field of BIG-DATA.
Big Data is a name given to problem-related to the processing, storage, management, and analysis of this kind of huge data.
According to an article posted in December 2017, The govt. Needs to process 1 Petabyte of data (on an average) every day. Such a huge VOLUME it is, 1PB = 1e+6 GB, no hard disk stores such a large data. If in case a hard disk is made to store such large data, it will lead to the fetching or storing problem, also known as I/O problem, this will reduce the putting and getting speeds from the storage. For example, you need to pay your house tax, and you enter your credentials and details, then you will have to wait for a day or two for just fetching the details of the payable tax. This is the second problem of Big-data known as VELOCITY problem.
To solve the Volume and Velocity problems, a concept of Distributed Computing came into the picture. Sharing of RAM, CPU, Storage, in a Master-Slave set up. The data is sliced and stored in slaves, this appears like that the master is able to handle all the data alone.
One Computer or the server is used as a Master, where all the tasks can be conducted, others share their resources.
This kind of set up can be achieved using software technologies like Hadoop.
And Now Almost all the Government Bodies, Businesses, Tech Companies are using This kind of setup and successfully dealing with the data.
