Building a web search engine from scratch in two months with 3 billion neural embeddings

blog.wilsonl.in

cross-posted to:
hackernews

Building a web search engine from scratch in two months with 3 billion neural embeddings

blog.wilsonl.in

Pro@programming.devM to

Technology@programming.devEnglish · 20 days ago

cross-posted to:
hackernews

End-to-end deep dive of the project, spanning a large GPU cluster, distributed RocksDB, and terabytes of sharded HNSW.

Comments

Lobsters;
Hackernews.

You must log in or register to comment.

Chat

Technology@programming.dev

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !Technology@programming.dev

Share interesting Technology news and links.

Rules:

No paywalled sites at all.
News articles has to be recent, not older than 2 weeks (14 days).
No external video links, only native(.mp4,…etc) links under 5 mins.
Post only direct links.

To encourage more original sources and keep this space commercial free as much as I could, the following websites are Blacklisted:

Al Jazeera;
NBC;
CNBC;
Substack;
Tom’s Hardware;
ZDNet;
TechSpot;
Ars Technica;
Vox Media outlets, with exception for Axios;
Engadget;
TechCrunch;
Gizmodo;
Futurism;
PCWorld;
ComputerWorld;
Mashable;
Hackaday;
WCCFTECH;
Neowin.

More sites will be added to the blacklist as needed.

Encouraged:

Archive links in the body of the post.
Linking to the direct source, instead of linking to an article talking about the source.

Misc:

Relevant Communities:

Beehaw Technology- Technology Related Discussions.
lemmy.zip Technology- Hard Tech news.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
9 users / month
9 users / 6 months
0 local subscribers
503 subscribers
451 Posts
0 Comments
Modlog

mods:
Pro@programming.dev