My First Post      My Facebook Profile      My MeOnShow Profile      W3LC Facebook Page      Learners Consortium Group      Job Portal      Shopping @Yeyhi.com

Pages










Showing posts with label data. Show all posts
Showing posts with label data. Show all posts

Monday, February 15, 2021

Tim Berners Lee created the web. Now he’s out to remake the digital world.

Tim Berners Lee is lately busy thinking over following questions:
  • The Internet Hasn’t Lived Up to Expectations, What is the Way Forward?
  • The internet was supposed to be an infrastructure that gave everyone access to self-actualize and create value no matter how competitive it became, but we are failing at that.

Let's note that the beauty of the web is that it is not just a solution or digital product, but it was invented as an infrastructure for other internet related solutions to be built upon, and it hasn’t really failed in that regards as we have seen the rise of various software solutions, mobile apps, websites, artificial intelligence, and the likes. The web has become a hub for people to create various forms of value even as technology and the internet continue to penetrate into every aspect of human life.

As people began to create imaginative solutions and platforms, the battle to stand out and lead various business categories, trumped the initial purpose of the internet as the web has now been dominated by certain gatekeepers and the various value chain is now being manipulated to the benefits of a selected few. There are various factors that have contributed to the present toxic and unhealthy state of the internet but they all seem to revolve around these three factors: access to the value in the ecosystem, data control, and market monopoly.



But now, Berners-Lee, 65, believes the online world has gone astray. Too much power and too much personal data, he said, reside with tech giants like Google and Facebook — “silos” is the generic term he favors, instead of referring to the companies by name. Fueled by vast troves of data, he said, they have become surveillance platforms and gatekeepers of innovation.

Releasing his creation for free 30 years ago, the inventor of the world wide web, Tim Berners-Lee, famously declared: “this is for everyone”. Today, his invention is used by billions – but it also hosts the authoritarian crackdowns of antidemocratic governments, and supports the infrastructure of the most wealthy and powerful companies on Earth.

Now, in an effort to return the internet to the golden age that existed before its current incarnation as Web 2.0 – characterised by invasive data harvesting by governments and corporations – Berners-Lee has devised a plan to save his invention.

This involves his brand of “data sovereignty” – which means giving users power over their data – and it means wrestling back control of the personal information we surrendered to big tech many years ago.

Berners-Lee’s latest intervention comes as increasing numbers of people regard the online world as a landscape dominated by a few tech giants, thriving on a system of “surveillance capitalism” – which sees our personal data extracted and harvested by online giants before being used to target advertisements at us as we browse the web.

The idea behind solid is to create a platform where every user of the web can create their own Personal Online data stores(Pods) that would be used to store their personal and private data and be used to regulate the way any service provider can use these data; an individual can host this data on a solid server with their personalized access to the data that is used to decide if software applications can read or write on the data, therefore, the user has total control over his/her data and does not have to worry about leaving any data behind whenever they delete a mobile app as the app cannot store their data but can only read or write on it.

The company (Inrupt is responsible for Solid), is already receiving positive responses as it claims that there are already is already claiming that there are already 1200 new Solid community members, more than 30 open-source developers building apps on the platform, and 60,000 developer accounts.

Others say the Solid-Inrupt technology is only part of the answer. “There is lots of work outside Tim Berners-Lee’s project that will be vital to the vision,” said Kaliya Young, co-chair of the Internet Identity Workshop, whose members focus on digital identity.

Berners-Lee said that his team was not inventing its own identity system, and that anything that worked could plug into its technology.

Inrupt faces a series of technical challenges, but none that are “go-to-the-moon hard,” said Bruce Schneier, a well-known computer security and privacy expert, who has joined Inrupt as its chief of security architecture. And Schneier is an optimist. “This technology could unlock an enormous amount of innovation,” potentially becoming a new platform as the iPhone was for smartphone apps, he said.

“I think this stands a good chance of changing how the internet works,” he said. “Oddly, Tim has done it before."

Friday, July 10, 2020

CSV delimiter linux Vs Mac : Resolving the issue of comma separated file read and write

Excel allows CSV that is Comma Separated Values in its filesystem. It uses comma as a delimiter.
And, this format is often used for exchanging data between programs. But there comes issues while working on different operating systems.


As per my research, there could be three versions of CSV formats included with Excel:


  • CSV (Comma delimited) (*.csv)
  • CSV (Macintosh) (*.csv)
  • CSV (MS-DOS) (*.csv)
The main difference arises because on a Macintosh each record (each line in the file) is terminated with a carriage return, as expected by the Mac. In the Windows, lines are terminated with a carriage return and line feed combination (CRLF). This can mess things up on the Macintosh.


Example suppose you are using Python for CSV Reader or writer mechanism then you should take care of two points:

1. use wb mode in file processing.

https://docs.python.org/2/library/csv.html#csv.writer


If csvfile is a file object, it must be opened with the ‘b’ flag on platforms where that makes a difference.

That is,  where you are writing file, open in binary format - wb mode
And, when reading - use rb mode

2. Use proper line separator. Better to use os.linesep



Even in viewing file also, you can do the difference if it is only a one time change:


Open your csv file with WPS Spreadsheets

Select the A column -> Data -> Text to Columns -> Next -> Select or define your delimiter -> Finish


You can also view a related post:

Cheers ;)

By the way I quit smoking. Did you know?

Sunday, April 23, 2017

Pen drive show empty even when data exists : SOLVED : Hidden files/ Virus Security

This is a common symptom when your computer, hard drive or the PD is infected with a malware. You are 100% sure that the disk contains data but that is not visible in the file explorer.

Now there can be multiple ways ti identify and fix it. They are mentioned as following:

1. Simplest is to check if the files are hidden and your explorer settings do not allow you to view hidden files.
To overcome this go to the file/folder settings View -> And select the 'Show System or Hidden files'

2. You definitely have to eventually scan the disk by Antivirus. Do that and the disk will become clean again

3. There is a short DOS level command that could help you overcome the situation.

Steps:

a. Open the DOS command. For the newbies, its a Black command terminal window
You can start it by goint to Start -> Run ->cmd

b. Change your working drive to the target drive. For eg. if your pendrive or disk is E: drive run the following command on DOS terminal
That is, type the following command and press Enter

E:\>attrib -h -r -s /s /d e:\*.*

Now this magical command will not display anything on the terminal. But your work will be done!

This will recursively make all your files and folder on the target drive as Non-hidden.

So now go to File System explore of Windows and open the drive. Voila! Your items are now visible!

Monday, March 11, 2013

Sort Blog Posts using Yahoo Pipes - Blogger Posts in alphabetical, chronological, date wise order


Problem Statement: Sort the Blog posts in a desired order like chronological, or Alphabetical order.
One of the many tools: Yahoo Pipes. We will use Yahoo Pipes to solve this problem.

Yahoo! Pipes is a web application from Yahoo! that provides a graphical user interface for building
data mashups that aggregate web feeds, web pages, and other services, creating Web-based apps from
various sources, and publishing those apps. Hence, Yahoo Pipes is an amazing Data Mining Tool.
Or, lets say a Data analysis tool. Now let us see what does it take to get to our solution of sorting the Blog posts in a desired order like chronological, or Alphabetical order. And that too using Yahoo Pipes!!

Step 1: Get the Blog Feed using Atoms
First we get the blog feed URL. In this case we will use :
http://http://new-it-discussions.blogspot.in/atom.xml
Then to include all posts we add this parameter to the above feed url :
?redirect=false&start-index=1&max-results=999
This will fetch 1000 posts from the blog. Now the complete feed url is :
http://http://new-it-discussions.blogspot.in/atom.xml?redirect=false&start-index=1&max-results=999


Step 2: Launch the Yahoo Pipes project to create data mashup for aggregating and analysing data
For this Just Create a Yahoo Profile and Register A Pipes Account.

Step 3: Using Yahoo Pipes to create Web based app combining data from different sources and applying analytics
The Left HAndside Menu will have different options and operators.
Use Feed Operator as Input. So, now input to you Pipe will  be the feed from your blog
Now Bring, drag and drop, a Sort Operator.
For reference, please see the image which shows my Pipe in development stage :)

I used the sort by itel.PubDate. This means sorting by Publishing date.
You can sort by Alphabetically and other options. You may also select Ascending or descending.
Now connect the output from this to the final output.
This compleet one Yahoo Pipe.
You can Run and then publish the Yahoo Pipe

Voila!!
Your First Yahoo  PIpe is created.


The Discussions For IT People Blog has created some Pipe for its own usage. You can view them at:
Discussions-For-IT-People-Pipe-BlogListAlphabetical
http://pipes.yahoo.com/pipes/pipe.info?_id=b74f9eeb70b27af587832209b7acfbd0
Discussions-For-IT-People-Pipe-BlogListChronological
http://pipes.yahoo.com/pipes/pipe.info?_id=c948a93a254e97b3ad59df059b2983cc