search engines :: Remember, remember, the velvet November


node:	search engines
template:	2
parent:	Software and Platforms
owner:	ulkas
viewed by:
created:	07.03.2016 - 09:07:00
updated:	18.04.2016 - 14:44:37

cwbe coordinatez:
101
63533
8106902
8207635
8106913

ABSOLUT
KYBERIA

permissions
you:	r,
system:	public
net:	yes

s7	0
dno	0
darmozrac	0
xF	0
timko	0

all forums about search engines (not services like google, bing). feel free to add more content
http://db-engines.com/en/system/Elasticsearch%3BSolr%3BSphinx

000001010006353308106902082076350810691308382908

https://www.xav.com/scripts/search/

Home > Fluid Dynamics Search Engine
FDSE is an easy-to-install search engine for local and remote sites. It returns fast, accurate results from a template-driven architecture. It is free and available with Perl source [ more Features ].

Latest stable version 2.0.0.0073 released August 22, 2005 [ see Version History ].

000001010006353308106902082076350810691308359856

FEMTO is an indexing and search system for queries on sequences of bytes. FEMTO stands for the FM-index for External Memory with Throughput Optimizations. This tool supports building large indexes in parallel with MPI and then searching large indexes with a multithreaded server.
https://github.com/femto-dev/femto

000001010006353308106902082076350810691308232755

ulkas 17.10.2016 - 10:06:11 [1K] , level: 1, UP NEW

Searx

https://asciimoo.github.io/searx/

Searx is a free internet metasearch engine which aggregates results from more than 70 search services. Users are neither tracked nor profiled. Additionally, searx can be used over Tor for online anonymity.



Self hosted

No user tracking

No user profiling

About 70 supported search engines

Easy intergration with any search engines

Cookies are not used by default

Secure, encrypted connections (HTTPS/SSL)

Hosted by organisations, such as La Quadrature du Net, which promote digital rights

000001010006353308106902082076350810691308194752

studijne materialy

00000101000635330810690208207635081069130819475208194753

https://books.google.sk/books?id=aFC_DAAAQBAJ&pg=PP1&dq=information+retrieval+9th+summer+school&hl=en&sa=X&ved=0ahUKEwin3dSm3anOAhXpAsAKHXCQCxoQ6AEINTAA#v=onepage&q=information%20retrieval%209th%20summer%20school&f=false

000001010006353308106902082076350810691308134736

http://searchkick.org/
based on elasticsearch

Searchkick handles:

stemming - tomatoes matches tomato
special characters - jalapeno matches jalapeño
extra whitespace - dishwasher matches dish washer
misspellings - zuchini matches zucchini
custom synonyms - qtip matches cotton swab
Plus:

query like SQL - no need to learn a new query language
reindex without downtime
easily personalize results for each user
autocomplete
“Did you mean” suggestions
works with ActiveRecord and Mongoid

000001010006353308106902082076350810691308134046

Rychly hint ako na to cisto s PostgreSQL:
http://rachbelaid.com/postgres-full-text-search-is-good-enough/

00000101000635330810690208207635081069130813404608135368

btw, sphinx si neriesil niekedy? my sme to mali nabindovane v psql databazke na 100gb tabulke, a ficalo to nenormalne rychlo. aj wildcard vyrazy brutalita

00000101000635330810690208207635081069130813404608134079

toto je len psql ficuria ci vseobecne sql?

a btw, daju sa tam robit aj fuzzy queries s relaxaciou?

0000010100063533081069020820763508106913081340460813407908134086

mysql ma svoj vlastny nativny FT tiez, ale to je MyISAM only, a na texty by som ho asi moc nepouzival, ja som cez ten MyISAM fulltext riesil kybca like vektor rychly selekt z databazy (bolo to radovo rychlejsie ako cez LIKE)

0000010100063533081069020820763508106913081340460813407908134082

zmenil som zahlavie, tam je pekny clanok kde je to rychlo zhrnute

0000010100063533081069020820763508106913081340460813407908134080

len psql ficura

000001010006353308106902082076350810691308133964

http://lucene.apache.org/solr/

Solr is highly reliable, scalable and fault tolerant, providing distributed indexing, replication and load-balanced querying, automated failover and recovery, centralized configuration and more. Solr powers the search and navigation features of many of the world's largest internet sites.

000001010006353308106902082076350810691308133953

https://twitter.github.io/typeahead.js/

a flexible JavaScript library that provides a strong foundation for building robust typeaheads

frontend simple autocomplete suggestions, not an search engine per se.

000001010006353308106902082076350810691308133946

http://sphinxsearch.com/

Sphinx is an open source full text search server, designed from the ground up with performance, relevance (aka search quality), and integration simplicity in mind. It's written in C++ and works on Linux (RedHat, Ubuntu, etc), Windows, MacOS, Solaris, FreeBSD, and a few other systems.

Sphinx lets you either batch index and search data stored in an SQL database, NoSQL storage, or just files quickly and easily — or index and search data on the fly, working with Sphinx pretty much as with a database server.

00000101000635330810690208207635081069130813394608133951

ak riesite search cez SQL databazu, tak toto je jednoznacne najlepsia volba, co sa tyka rychlosti aj pri velmi, velmi velkych objemoch dat.

vie sa to zazrat priamo do mysql enginu a prakticky nativne vam servovat vysledky - vy len dalej pouzivate pramo konzolu a povodne sql dotazy, a akonahle dotazuje sphinxom naindexovane policko, prepne ten engine na pozadi, a vrati vam vysledky ako keby sa nic neudialo.

000001010006353308106902082076350810691308133939

elastic, elasticsearch
https://www.elastic.co/

Distributed, scalable, and highly available
Real-time search and analytics capabilities
Sophisticated RESTful API

00000101000635330810690208207635081069130813393908829535

Neviem ci ste to postrehli ale po MongoDB prechadza na SSPL uz aj ElasticSearch/Kibana :-(

Ak teda poskytujete tretim stranam sluzbu (ktora vyuziva ELK/MongoDB) tak mate na vyber:
1. ostat na verzii (ktora nie je pod SSPL) a zamrznut v case
2. prejst na novu verziu, dalej pouzivat ju bez platenia ale zverejnit kod svojej sluzby
3. prejst na novu verziu, zacat platit a nezverejnit kod svojej sluzby
4. najst alternativu a prestat pouzivat to co je pod SSPL

src: https://anonymoushash.vmbrasseur.com/2021/01/14/elasticsearch-and-kibana-are-now-business-risks

co si o tom myslite?

00000101000635330810690208207635081069130813393908286232

nemate niekto skusenosti s elasticsearchom ?
Nikdy som elastic neriesil tak tapam v tme :) , problem je nasledovny error :

"reason" : "SearchPhaseExecutionException[all shards failed]; nested: RemoteTransportException[[YFTCeY1][127.0.0.1:9300][indices:data/read/search[phase/query]]]; nested: IllegalArgumentException[Fielddata is disabled on text fields by default. Set fielddata=true on [dns.question.etld_plus_one] in order to load fielddata in memory by uninverting the inverted index. Note that this can however use significant memory.]; ",

Netusim ako pridat fielddata=true na dns.question.etld_plus_one. Neviete niekto ako to spravit ? Vdaka :)

E: ide o elastic 5.1, kde sa zrejme nieco zmenilo a stringove polia musia obsahovat fielddata true aby sa dali prehladavat (toto je moja cista dedukcia)

000001010006353308106902082076350810691308133936

http://project.carrot2.org/

Carrot2 is an Open Source Search Results Clustering Engine. It can automatically organize small collections of documents (search results but not only) into thematic categories.

axone future LAB
axone forumz