129 commits

Author	SHA1	Message	Date
JDC	7903db6dfb	Add ArchiveResult Manager and sorted indexable filter	2020-12-06 01:13:39 +02:00
JDC	823df34080	Use QuerySets for search backend API instead of pks	2020-12-06 01:12:47 +02:00
JDC	47daa038eb	Implement flush for search backend after remove command	2020-12-06 01:12:47 +02:00
JDC	5f6673c72c	Implement backend architecture for search engines	2020-12-06 01:12:46 +02:00
JDC	b1f70b2197	Initial implementation	2020-12-06 01:12:45 +02:00
jdcaballerov	c8d8346e4d	Remove duplicate context after rebase	2020-12-03 15:44:21 -05:00
jdcaballerov	8ac7a760c9	Fix num_links missing in public index	2020-12-03 08:32:49 -05:00
jdcaballerov	69897f6121	Hotfix public page search ... No ordering causes warning and fallback to default unfiltered QuerySet	2020-12-03 08:32:49 -05:00
Nick Sweeting	104553489f	remove redundant utils file	2020-11-28 02:12:27 -05:00
Nick Sweeting	7fdea91311	fix static html num_outputs info	2020-11-28 02:01:53 -05:00
Nick Sweeting	fde65c3b7d	fix public index missing template context	2020-11-28 01:29:34 -05:00
Nick Sweeting	46a53eafdb	simplify history helper	2020-11-28 01:14:45 -05:00
Nick Sweeting	9661c863b3	css style tweaks for icons	2020-11-28 01:06:23 -05:00
Nick Sweeting	910f3d65c7	default function args can never be mutable	2020-11-28 01:06:11 -05:00
Nick Sweeting	411fdcac87	use database for num_outputs instead of legacy json	2020-11-28 01:05:53 -05:00
Nick Sweeting	00bb55203e	always show WARC icon with opacity set based on exists	2020-11-27 23:45:49 -05:00
Nick Sweeting	efe3027797	Merge branch 'master' into archive-result	2020-11-27 23:18:11 -05:00
Cristian	4b3f72202b	feat: Bump django, update migration and change cmd to use JSONField	2020-11-27 16:23:27 -05:00
Cristian	f61e6a74bb	feat: Re-add unused icons in list view	2020-11-27 15:55:37 -05:00
Nick Sweeting	f84f288bef	Apply suggestions from code review ... minor nit	2020-11-27 00:01:34 -05:00
Cristian	34a1a6d30d	fix: Update model according to code review	2020-11-23 18:28:43 -05:00
Nick Sweeting	0e2ccbc10d	update urls to new repo path	2020-11-23 02:06:46 -05:00
Nick Sweeting	afe9319c25	Merge pull request #537 from TrAyZeN/master	2020-11-18 23:20:41 -05:00
JDC	8b0250caeb	Fixes 500 error on search ... The class SnapshotAdmin search_fields includes the tags ManyToMany field causing a django.core.exceptions.FieldError: Related Field got invalid lookup: icontains error. A related search field tags__name should be used.	2020-11-17 08:36:03 -05:00
TrAyZeN	a05485f85c	Fix file icons order	2020-11-14 17:44:06 +01:00
Cristian	0f13087a09	refactor: Remove unneeded prefetch related	2020-11-12 13:58:13 -05:00
Cristian	c565fad75c	feat: Use prefetch related to reduce the number of queries to the database on public index view	2020-11-12 11:37:56 -05:00
Cristian	8cfad64271	feat: Add specific logic for archive_org icon	2020-11-12 11:09:34 -05:00
Cristian	e594e6a75a	feat: WARC link points to the first warc result in target path	2020-11-12 10:57:31 -05:00
Cristian	b237e412df	feat: Finish reversal. Add ArchiveResults that are not found in the index.json	2020-11-12 10:30:41 -05:00
Cristian	f7f0bebdcc	feat: Modify migration reverse function to restore index (WIP)	2020-11-11 15:26:54 -05:00
Cristian	508a0bb06e	refactor: Unpack extractors tuple instead of using the index to access the relevant information	2020-11-10 12:38:29 -05:00
Cristian	71655220ad	feat: Add warc to list and limit check to succeeded archive results	2020-11-05 07:54:40 -05:00
Cristian	4484491fb7	feat: Create ArchiveResult after finishing an extractor process	2020-11-04 11:22:55 -05:00
Cristian	b3e0400bc0	feat: initial functional version with icons calculated based on archive results	2020-11-04 10:31:20 -05:00
Cristian	309a87e8fe	feat: Add extractor field to the database	2020-11-04 07:28:02 -05:00
Cristian	8f3c03a0f9	feat: Initial (and naive) ArchiveResult model	2020-11-03 09:54:02 -05:00
Cristian	ac0ec160d1	lint: Fix warnings in master branch	2020-11-02 08:51:48 -05:00
Nick Sweeting	22fb9c2ad7	tweak icons	2020-10-31 19:32:43 -04:00
Nick Sweeting	651d6c4447	bold snapshots over 50MB	2020-10-31 07:57:11 -04:00
Nick Sweeting	ac9e0e356d	config fixes	2020-10-31 07:57:11 -04:00
Nick Sweeting	18355dc2c6	clean up config loading in settings and config file layout	2020-10-31 03:08:03 -04:00
Nick Sweeting	aede134ab3	temporarily disable icon highlighting in favor of performance	2020-10-30 05:12:33 -04:00
Nick Sweeting	e727af6f22	allow Path args to get_dir_size and copy_and_overwrite	2020-10-24 22:47:18 -04:00
Cristian Vargas	a850b4a9d9	Merge branch 'master' into tags	2020-10-20 08:23:25 -05:00
Cristian	62c78e1d10	refactor: Remove django-taggit and replace it with a local tags setup	2020-10-12 13:47:03 -05:00
Nick Sweeting	6c704fa8cf	Merge pull request #498 from adamwolf/bookmarklet ... Add a bookmarklet	2020-10-09 21:59:07 -04:00
Cristian	10384a8a6f	style: Improve look of tags in admin list	2020-10-07 10:15:56 -05:00
Cristian	b9e5b781a7	fix: Avoid creating empty tag on migration	2020-10-07 09:59:49 -05:00
Cristian	62f3d648d4	fix: reverse_func functional	2020-10-07 09:46:10 -05:00