Category:
Created:
Updated:
multi-crawler
internet-crawlers are the base of the information-revolution... and how google became big... this bots are searching the net and are catching they results to make them readable for humans...
i'm into it right now and have installed such a crawler at holyrawly.com...
but the multi-crawl is another task... it take a lot of hardware and software basics to establish this technology... i'm right now testing a multi crawl on google cloud
tested with several parallel running crawlers this technology can be scaled up depending on hardware... to the level of google
0
0
0
0
0
0
0
Comments (1)
Not logged in users can't 'Comments Post'.
Info
Featured Posts
https://github.com/DuskoPre/AutoCoder/wiki
i'm not just testing LLMs but also creating a semi-liquid neural network (advanced LLM) with chromadb:
https://github.com/DuskoPre/liquid-neural-network-with-chromadb-cache
it seems there is a mayor upgrade for LLMs possible trough classifications (managing-system) of inputs to the LLM. the model is still static but trough the implementations of the classifier it can be made semi-liquid.
#dichipcoin
