16 commits

Author	SHA1	Message	Date
jdcaballerov	172197ae01	refactor: Remove if LENGTH and use text chunker for every input	2020-12-06 01:14:39 +02:00
jdcaballerov	5a6b814c79	Add exception handling for indexable content reader	2020-12-06 01:14:38 +02:00
JDC	15fbd81480	Change MAX_SONIC_TEXT_LENGTH	2020-12-06 01:14:38 +02:00
JDC	db9c2edccc	Add log print for url indexing	2020-12-06 01:14:38 +02:00
JDC	0acf479b70	Partition long strings in chunks for sonic	2020-12-06 01:14:38 +02:00
JDC	caf4660ac8	Add indexing to update command and utilities	2020-12-06 01:14:37 +02:00
JDC	23a9beb4e0	Add ignored extensions in ripgrep search	2020-12-06 01:13:39 +02:00
JDC	95382b3812	Add ripgrep rg search backend and set as default	2020-12-06 01:13:39 +02:00
JDC	4eeedae815	Exception handling for indexing and searching	2020-12-06 01:13:39 +02:00
JDC	fb67d6684c	fix: Return empty QuerySet instead of list	2020-12-06 01:12:47 +02:00
JDC	823df34080	Use QuerySets for search backend API instead of pks	2020-12-06 01:12:47 +02:00
JDC	f383648ffc	Use a generator for snapshot flush from index	2020-12-06 01:12:47 +02:00
JDC	47daa038eb	Implement flush for search backend after remove command	2020-12-06 01:12:47 +02:00
JDC	c2c01af3ad	Add config for search backend	2020-12-06 01:12:47 +02:00
JDC	5f6673c72c	Implement backend architecture for search engines	2020-12-06 01:12:46 +02:00
JDC	b1f70b2197	Initial implementation	2020-12-06 01:12:45 +02:00