hckrnws
I remember that. A few weeks later ran a script to count all the websites on the Internet.. 324 at that time.
Was your script the very first web crawler or did you just have a list?
I'm also curious because I remember that the first time I used the Internet (not internet, as it is nowadays), I had to buy a paper book with categorized links to websites.
Connecting... Waiting... It was slow, both because of dial-up kbit/s and ping to websites, and every page felt like you were literally sending a request to another part of the planet. It felt like that was actually happening, and it was very different from what we experience now.
But most importantly, there were zero funds/VC in that Internet. Only very niche websites, zero online services, even email was difficult to obtain and felt like a real privilege. Only the fact of being connected made everyone feel not a stranger.
I kind of miss that Internet, but I'm grateful that once I was part of it.
There’s a page “Robert’s comments on Tim’s MIT trip” that says:
“I hope this does not offend Brewster, but I hope, probably in vain, that the commercialists will stay out of the Web world. Selling information is like selling air and water to me, though of course you need to pay the people who provide the information. Your comment already points out some of the bad side-effects of selling per access, or worse, tariffs per type of information or per item! Like: today's newspaper is 10CHF because there is this item in it which everyone wants to know about.”
Interesting too that an article on the front page the other day was about microtransactions for news.
I wonder which Robert said that.
The problem of viable news business models persists, and micro-payments have been proposed, but I have yet to see a viable implementation. Also, I think paying per news story isn't the right level of granularity. Articles that are less popular also need to be written, and the people that wrote them need food, too.
"I'm also curious because I remember that the first time I used the Internet (not internet, as it is nowadays), I had to buy a paper book with categorized links to websites."
I was looking at one of these books the other day called "The Internet Yellow Pages"
In the early 90s McGraw Hill published a book with this title
I found a version published by Que (Pearson Education) from 2007 (I suspect there may even be later editions)
That's 14 years into the public www
This was right before the iPhone
I never used these books. The best resources I remember were lists of sites published via FTP
Some of the nostalgia is still easily accessible via textfiles.com
I still use the internet in much the same way I did when I was first connected through a university. UNIX-like OS, no graphics, 100% command line
The main difference between then and now for me is the hardware and bandwidth
Everything is so much faster
IME, generally any slowness today is due (directly or indirectly) to the commercialisation ("monetisation") of _traffic_, e.g., ads, tracking, or having to use Tor to avoid all the nonsense
Originally the idea of commercial use of the internet was to sell products and services (excluding "advertising services"), not to sell and "monetise" _traffic_
Internet subscriber bandwidth is now used by companies for free to perform data collection, surveillance, telemetry, mostly undetected by the subscriber
For example, the majority of "Big Tech" revenues do not come from selling products and (non-advertising) services but from performing data collection, surveillance and "ad services". Even popular subscription software that predated the web, e.g., MS Windows, is engaged in data collection, surveillance and ads/tracking as a "business". Apple, once a traditional hardware company, is engaged in this activity as well
1. I have been doing some information retrieval experiments and the speed can be mind-blowing
Crawler. Heh.. never thought of it that way.
Wow. Which year was it?
In 1993, you could refresh the home page of Netscape (Mosaic) every day and it would mention new sites that had been added. That became unmanageable quickly, which is when two dudes from Stanford started a directory.
The NCSA What's New page!
https://www.computerhistory.org/revolution/the-web/20/388/21...
I've been trying to track down "What's New" for a long long time. If memory serves, there was a daily email titled "What's New on the World Wide Web" - very possibly the source for this monthly summary.
It was a fascinating way to experience the early WWW's exponential growth. It started out small, but once it began to grow, you could see it expanding faster and faster practically in real time.
At first it only took seconds to give the daily list a good once over. Over time it started taking minutes, then 20 minutes or half an hour (if things weren't too busy at work), and eventually it morphed into almost another full time job. There was just no way to keep up. Around that time they stopped sending it out.
From a historical point of view, these daily emails and monthly summaries would be a terrific resource for those interested in the early Web. It's hard to believe now that there was once a time when you could literally check out every new Web site as they came online.
If you remove commercial and edu and gov sites it's still doable today to track NEW unique websites today. There are less and less personal webpages due the instagram and fb etc
I keep track of these on my website, Well Made Web. You may like a visit: https://wmw.thran.uk/
It would be nice if a "What's new?" could be implemented by the Web protocol, a challenging task in a decentralized network.
New domain registrations would have to be queryable and the result set merged across all domain registrars globally.
That would make (completed) Web crawling easier, esp. of pages not interlinked (yet) with others.
Why the Web doesn't have a Scottish Accent
I once asked for funding from a Scottish business angel.
He confided to me that his biggest mistake in life was saying no on a phone call by a certain Tim Berners-Lee, who was looking for someone to help implement a browser for the "World Wide Web".
"Why did you reject him?" I asked. "'World Wide Web' sounded pretentious." said the man who got independently wealthy by selling a company that produced hypertext software (incl. browsers) for technical documentation running on Sun workstations...
...TBL turned to the NCSA team in the U.S. instead, and the rest is history.
I belive that an early beowser, possibly Mosaic, had an edit button. Think of that and the fundamental change of internet philosophy it implies!
One early tool in this space was Navipress (which AOL bought out and made into AOLpress) which is notable for having been used by a certain Tim Berners-Lee to write a book:
The original idea behind a protocol which did updates as much as reads was later realised as Wikipedia and similar sites.
Just yesterday, this blew my mind: https://news.ycombinator.com/item?id=47096599
Yeah, and the original HTTP had PUT and DELETE methods.
Hence GET / POST / PUT. The WWW was designed to edit documents directly.
A little later, but I have a key chain from a dealership that has their website advertised on it, they didn't have a domain name so it's advertised as http://123.123.123.123/web.htm
Yeah, I made a website as part of a class at BCIT in 1995 and we just had a raw IP so I was showing people my awesome website on http://142.232.162.27 (actual IP) every chance I got.. for all like, 2-3 some-odd people I knew who had computers and had internet access. Luckily I quickly thereafter got a Geocities site which was just a little easier to remember/share lol
The line mode [1] made me pause. Not because you can do anything too useful (most of the cool links are dead, or telnet) but because it seems like a really cool place to explore, learn, and hack.
No ads, no random tits, nobody trying to convert you to their politics, trying to scam you, or telling you to kill yourself. Just people sharing interesting things.
Really makes me excited for the internet until I close the tab.
[1] http://line-mode.cern.ch/www/hypertext/WWW/TheProject.html
It just blew my mind! I suppose I shouldn't be surprised at all, JS was written for manipulating the DOM but I was NOT expecting a cool terminal style with a typing/Matrix-style transition animation from some of the first webpages ever.
My brain even ascribed a CRT distortion effect to it, even though that's not actually happening.
edit: okay, no, I am an idiot. Those pages were made in 2013:
When this was first created, how did people usually navigate back to the previous page? I notice there are no "previous" or "home" links here. Was there a "back" button/key, or would you have to edit the URL directly?
Edit: Answered my own question I think. If you choose the option to browse "using the line-mode browser simulator", you can literally type in "Back" to go back.
This site has a way to experience as it once was. I’m on mobile now, but from what I remember when I tried it, each link opened up a new document window. So the idea of going back wasn’t relevant. You’d simply close the window.
Yeah, I just wrote an edit to my comment actually after I noticed that. It in fact has an explicit Back command you can run; one of the few commands it supports.
It looks like you can also shorten "Back" to "b".
So far, I like this line-mode browser simulator much more than what is commonly available for the command line (lynx or links2). Does any one know of a modern implementation of it? (Where links are numbered instead of the user having to navigate around the document).
There are browser extensions such as Vimium C that provide keyboard-based navigation.
We used telnet. There were no graphics per se. Before www the "interactive" internet was gopher and wais and co.
Navigation was moving a cursor around to highlight points of interest, some of which would be links to further stuff or controls to do something like go back or forwards.
Install lynx or links2 (ie text mode browsers) and you'll get the idea.
The vaguely graphic efforts with browsable content that you might recognise before www were the likes of Compuserve. That got you a sort of forum style interface.
It's quite hard to explain just how fast things have moved over the last 40 odd years (I'm 1970 to date - 55). I should also point out that my granddad saw rather a lot of change from 1901 to 1989. To be honest the last 15 odd years are even madder than the previous 25 and that's just my own personal recollection.
The original NextStep design's simplicity and colour scheme appeals to me.
I hope someone will write a "skin"/theme for Ladybird (whose August alpha release we are keenly awaiting) that looks like that before I'll have to do it myself...
It’s impressive how quickly the WWW became mainstream, given how few people had internet access back then. Bitcoin is now 16 years old but compared to the WWW in 2008 is hardly used on a daily basis.
It's not that WWW was quick, it's that Bitcoin is useless.
False, it was much more annoying to buy drugs online pre-crypto.
How did people do that before crypto?
Money in mailed in envelopes. Western Union. Prepaid credit cards. Stolen credit cards. Bank transfer to a legitimate business that funnels it to their drug empire.
For agent to agent payments, Bitcoin/Ethereum could be quite useful now, as traditional payment protocols and banks are not likely to provide decent APIs any time soon.
Ugh, memories. I'm so old my first web browser was Mosaic and I think I saw this. I used a provider called Texas MetroNet that served up dial-up PPP connections for $45 a month on a speedy 28.8K baud modem. Days of wonder, I tell ya.
New days of wonder seem to be ahead, though. That said, there's about 100X more angst involved these days.
[dead]
The sad part is, how infinitely more functional these simple, static HTML documents are, compared to much of the shit that floods the "modern" web.
Ofc these pages cannot replace SPAs. That's not the point. The point is: Much of the web isn't SPAs. And much of what is SPAs shouldn't be SPAs. Much of the web is displaying static, or semi-static information. Hell, much of the web is still text.
But somehow, the world accepted that displaying 4KB of text somehow has to require transmitting 32MiB of data, much of it arbitrary code that has no earthly business eating my CPU cycles, as the new normal. Somehow everyone accepts that text-only informational pages need to abuse the scroll-event, or display giant hero-banners. Somehow, having a chatbot-popup on a restaurants menu-page is a must (because ofc I wanna talk to some fuckin LLM wrapper about the fries they sell!!!), but a goddamn page denoting the places address and telephone number is nowhere to be found.
https://idlewords.com/talks/website_obesity.htm
This talk was given over a decade ago, and its takeaways are as relevant today as thy were back then, and in fact maybe even more so.
> Somehow everyone accepts
Everyone did accept that because when you needed information from a page that pulls that shit, you don't have a choice, and when you did have a choice, all the others did it too.
Nowadays people just ask ChatGPT for the information they need so they don't have to visit those awful sites anymore.
Some of the stuff we have been adding since then is GOOD though.
Some examples:
We now have to accommodate all types of user agents, and we do that very well.
We now have complex navigation menus that cannot be accessible without JavaScript, and we do that very well.
Our image elements can now have lots of attributes that add a bit of weight but improve the experience a lot.
Etc.
Also, things are improving/self-correcting. I saw a listing the other day for senior dev with really good knowledge of the vanilla stuff. The company wants to cut down on the use of their FE framework of choice.
I cannot remember seeing listings like that in 2020 or 2021.
PS.
I did not mean this reply as a counterpoint.
What I meant to say is, even if we leave aside the SPAs that should not be SPAs, we see the problem in simple document pages too. We have been adding lots of stuff there too. Some is good but some is bad.
> We now have to accommodate all types of user agents, and we do that very well.
Simple websites don't even care about the UA.
> We now have complex navigation menus that cannot be accessible without JavaScript, and we do that very well.
Is there an actual menu which is more than a tree? Because a dir element that gets rendered by the UA into native menu controls would be just so much better.
Websites do care about the UA. They don’t care, at least most don’t care, about the User-Agent string. That is different.
About an element that gets rendered into native menu controls, I am not sure. I haven’t been following closely for the last two or three years. But that seems like a good candidate for a native element. 9 out 10 websites need it.
Fascinating reading if you care about system design. Who would imagine this charged the world.
https://info.cern.ch/hypertext/WWW/DesignIssues/Overview.htm...
Has anyone been able to recover the original source code? The README here: https://info.cern.ch/hypertext/README.html mentions a src/ directory under the same location but it 404's to me.
Would love to see the source for the original httpd.
Maybe here you'll find what you are looking for: https://www.w3.org/Daemon/
Though you can browse and download the latest version 3.0A (1996), there is a directory where they have older versions, but its a bunch of files mixed up with different versions. https://www.w3.org/Daemon/old/
Nice! HTDaemon.good, HTDaemon.old.c, some classic version control practices going on here.
This was in Gopher first, where you had to click a link to view a picture. Then I heard about Mosaic, where you can have pictures and text on the same page. Some problems emerged, until I learned you use <p> to separate chapters: https://timonoko.github.io/alaska/index.htm
Interesting that `<dl>` goes back that far, I figured it'd be later.
[1] describes the initial elements of HTML. Almost all were derived from an inofficial SGML folklore tagset with the notable exception of <a> and http URIs.
Xanadu
Ted Nelson's dream since early `60s: all the world literature in one publicly accessible global online system (analogy: you can today get a telephone link from anywhere to anywhere, so why not from any text to any other?). Every reference to a text will lead to royalties being paid automatically to the author. Autodesk, (the makers of AutoCAD) will produce a product "real soon now". Includes the use of full versioning (claimed to be horrifyingly complex), "hot links" (called transclusions) and zippered texts (eg. parallel texts like for translations or annotations.)
Sometimes I really miss the pure, text-first web. No popups, no cookie banners, just raw information.
No monetisation. Thats what makes everything shit.
You didn’t have cookie banners because you didn’t have cookies, because there is no need for most websites to have cookies.
I've come across this before, one thing I haven't realized is that in addition to an emulator of the line browser, they're also offering an emulation of the original NeXT browser WorldWideWeb:
Sure, but have you heard the Eurovision Song contest entry about the web: https://www.youtube.com/watch?v=Zc9quuVYZF4
I was expecting some sort of futuristic electronic song, Daft Punk inspired, a bit of synthesizer... not this!
On university campus when our student dorms got internet wired, we first got Gopher, and I remember - because it was hard to follow all these technology developments - that the web was like 'suddenly' there, and we started surfing. Everyone making the switch. Early pages were often copies of their Gopher equivalents.
At least partially down at the moment, but it's super fun looking through their service status board. I love little glimpses into other people's worlds. https://cern.service-now.com/service-portal?id=service_statu...
It reminds me of a fun fact: HTTP/0.9 websites are the fastest because they were created years ago and have simple content.
1992 seems a bit late. Wasn't this first website put online on 20 December 1990?
Not bad PageSpeed scores for the first site:
Performance: 100 Accessibility: 86 Best Practices: 92 SEO: 90
This is great. I particularly enjoyed this entry in the FAQ about how to find web pages: https://info.cern.ch/hypertext/WWW/FAQ/KeepingTrack.html
> When (s)he has found an overview page which (s)he feels ought to refer to the new data, (s)he can ask the author of that document (who ought to have signed it with a link to his or her mail address) to put in a link.
> By the way, it would be easy in principle for a third party to run over these trees and make indexes of what they find. Its just that noone has done it as far as I know
In the mid 70's, I was a graduate CS student at USC's Information Sciences Institute. I remember my feeling of awe when I used Arpanet (or was it Darpanet) to log into London and do stuff there. Wow!
Well that makes me feel old. I remember making my first site on Geocities not long after.
I really like how different and the same the html tags are.
how did we go from this to nextjs?
There's a difference between document-based web sites like this one and web applications. The potential for web applications has mostly emerged as a side effect of the introduction of JavaScript. Back then, JavaScript was supposed to only add minor enhancements to web sites.
Well... Right here on the the very first website Tim Berners-Lee talks about how to build interactive web applications (here called "gateways"), albeit server-side rather than client-side: https://info.cern.ch/hypertext/WWW/FAQ/Server.html
Money. Ruins everything. And also enables. So it's a win/lose situation.
More than money, it's the curse of going mainstream.
I love that there is no attribution. Says a lot about the concept of collaboration and know sharing in those early days.
Banned in UAE (at least on DU)
That's rather sad, its just a museum exhibit about the www, so prohibition might look like a pathetic attempt at revisionism.
What is DU?
Looks like DU is an UAE telecom company.
Still faster than most websites
I appreciate the HTTPS support
declaring a website to be "first" introduces a definitional problem.
to put it in terms of a simple example, you need several HTML pages before one of them can link to another, but so far that's just hypertext. then you need pages spread out across plural sites to be able to create a web.
I found it via gopher and wais - I can't remember which one did what, it was a fair few years ago.
I telnetted from my PC to a VAX, then to a X.25 PAD, then onto a Janet system, then to somewhere in the US and then to CERN. Eventually I'd get a menu with a link to the www. I'd then navigate the www with different keystrokes.
www was/is free form links to stuff instead of hierarchical menus. It was an evolution not a revolution and there is no need to invoke "chicken or egg".
so you're saying that gopher was the web. i've heard it said before. if you are scared to discuss a chicken and egg problem, you are exactly who should hear it.
Ah, fond memories... First website in Poland was the homepage of the Faculty of Physics of the Warsaw University (been there at that time). It was 1993 I think, although wayback machine stores a newer snapshot (1998), but it looks the same as original page: https://web.archive.org/web/19980120060239/https://www.fuw.e...
Related:
CERN rebuilt the original browser from 1989 (2019)
A (1992) copy.
Website about this project: https://first-website.web.cern.ch/
Some previous discussions:
6 months ago https://news.ycombinator.com/item?id=45125239
Everyone in silicon valley would do well to remember why the web was built (by other people, elsewhere).
[dead]
Comment was deleted :(
Comment was deleted :(
[dead]
[dead]
Comment was deleted :(
Crafted by Rajat
Source Code