194 commits

Author	SHA1	Message	Date
Daniel Siepmann	769fb8237b	TASK: Add data processing to search result ... Search results are now processed through data processing by search service. The result will be a SearchResult model from our domain. Also SearchResult will execute new queries, e.g. from paginate widget, through SearchService to apply data processing again. Remove duplicate stub code to trait, to keep own logic and code clean.	2018-03-06 09:04:47 +01:00
Daniel Siepmann	2998c43ba8	TASK: Refactor data processing ... Use own service to handle data processing. Classes like indexer should not know anything about the structure and how to process the data. Also rename record to data, as we can process just any data in form of an array. Relates: #116	2018-03-01 08:03:51 +01:00
Daniel Siepmann	350f8a52b6	FEATURE: Use extbase for processor instantiation ... This way injects will be resolved inside of processors, enabling developers to inject dependencies. We use inject instead of constructor as indexers mostly will change the constructor and should not need to add the objectmanager. Resolves: #117	2018-02-27 14:47:22 +01:00
Daniel Siepmann	fef2bdac89	Merge pull request #115 from Codappix/feature/112-resolve-relations-for-new-records ... BUGFIX: Allow indexing of new records with their relations	2018-02-23 10:20:58 +01:00
Daniel Siepmann	47b3282034	BUGFIX: Allow indexing of new records with their relations ... Relations were inserted by TYPO3's DataHandler after indexing and were therefore not indexed. We now use a later hook after DataHandler has finished everything, so we know that we can index. As it's not relevant, we do not differentiate between add and update anymore, as both trigger "indexDocument" internal. Resolves: #112	2018-02-22 22:14:44 +01:00
Daniel Siepmann	ebaeaf4c92	TASK: Support PHP 7.0 ... As some (e.g. debian) do not provide PHP 7.1 and we did not use so much features which were introduced in PHP 7.1, we add support for PHP 7.0.	2018-02-22 21:59:13 +01:00
Justus Moroni	c994a32ac1	BUGFIX: Make BackendUtility usable in frontend ... BackendUtility used LanguageService which only works in the backend. Extend BackendUtility and use TSFE instead.	2018-01-29 22:49:29 +01:00
Daniel Siepmann	02ef86b67b	FEATURE: Provide new feature to configure fields to search in ... This enables you to search only in some fields. Also if some fields contain mapping, you can add them in addition to e.g. `_all`.	2017-11-29 18:57:09 +01:00
Daniel Siepmann	b7b783a7fe	TASK: Use Code Sniffer at travis ... This way we need no external service. Each developer can fully run all tests and cgl on local environment. Also this integrated better into IDEs and editors.	2017-11-11 16:52:02 +01:00
Daniel Siepmann	689d8f0c53	Merge pull request #96 from Codappix/feature/refactor-dataprocessing ... !!!|FEATURE: Make data processing available to all indexer	2017-11-10 22:05:49 +01:00
Daniel Siepmann	7472cab660	Merge pull request #98 from Codappix/feature/provide-form-finisher ... FEATURE: Provide form finisher for integration into form extension	2017-11-10 22:05:34 +01:00
Daniel Siepmann	03d4d7493c	Merge pull request #99 from Codappix/feature/provide-index-deletion-command ... FEATURE: Provide command to delete whole index	2017-11-10 22:05:02 +01:00
Daniel Siepmann	0815eaff6b	BUGFIX: Remove records during update if no longer available ... E.g. update is to deactivate a record. In this case we will not be able to update the record but should delete him instead.	2017-11-10 13:48:53 +01:00
Daniel Siepmann	a3a46f5cb5	FEATURE: Provide command to delete whole index ... This is necessary, e.g. for complete re-indexing.	2017-11-10 13:22:15 +01:00
Daniel Siepmann	31202f8882	FEATURE: Provide form finisher for integration into form extension ... Provide a finisher, working as a proxy, to internal data handler, which is already used for Hooks in TYPO3 backend.	2017-11-10 12:31:06 +01:00
Daniel Siepmann	e1a14b2f04	!!!|FEATURE: Make data processing available to all indexer ... Before data processing was applied for TCA only, through tca table service. Now it's applied much later in process and in abstract indexer. Therefore all indexer will run data processing if configured.	2017-11-08 21:05:53 +01:00
Daniel Siepmann	379dddf8ac	BUGFIX: Also remove fields containing "null"	2017-11-08 20:36:04 +01:00
Daniel Siepmann	0159315183	FEATURE: Add data processor to remove fields for indexing ... Add a new processor, with docs and tests, to allow removal of fields before sending them to search service like elasticsearch. E.g. remove sensitive information that should not be available.	2017-11-08 20:20:37 +01:00
Daniel Siepmann	43ec410eb5	Merge pull request #93 from Codappix/hotfix/allow-empty-filter ... BUGFIX: Do not remove submitted filter if configured one is empty	2017-11-02 22:41:20 +01:00
Daniel Siepmann	8206a1ec59	BUGFIX: Do not remove submitted filter if configured one is empty ... This will be the case if you add a flexform to the plugin with no value. Then an empty filter is configured and you will not be able to submit a value for this filter.	2017-10-29 17:08:33 +01:00
Daniel Siepmann	c38f7b9d6a	TASK: Move configuration logic into own class ... Also add tests for new code.	2017-10-29 13:44:17 +01:00
Daniel Siepmann	bf91c4a5ba	TASK: Allow fields and sorting to contain a condition ... This way integrators can configure when the sorting and fields should be added.	2017-10-29 12:25:25 +01:00
Daniel Siepmann	d937266bf5	Merge remote-tracking branch 'origin/develop' into feature/geo-search	2017-10-29 11:41:43 +01:00
Daniel Siepmann	86d02f7b8d	TASK: Allow integrators to use GET with minimal overhead ... Allow to map search request even if no trusted properties exist. Also cache initial call to plugin. This allows to use GET as submit for forms with minimal arguments in URL.	2017-10-26 10:05:32 +02:00
Daniel Siepmann	07a4fec622	WIP|FEATURE: Allow fields and sorting to be configurable	2017-10-23 16:35:38 +02:00
Daniel Siepmann	b1f81c0d3b	WIP|FEATURE: Add field and sorting ... Sort result by distance and provide distance to result items.	2017-10-22 17:51:04 +02:00
Daniel Siepmann	8d343ee97f	FEATURE: Finish filter configuration for geo_search	2017-10-22 17:34:48 +02:00
Daniel Siepmann	636ef78a14	WIP|TASK: Remove sort and add filter ... As we filter for distance and do not sort.	2017-10-22 11:23:28 +02:00
Daniel Siepmann	e1764dca13	FEATURE: Add GeoPoint Processor ... Document data processors. Add test for new data processor.	2017-10-20 16:36:26 +02:00
Daniel Siepmann	3f1c3db2a2	Merge remote-tracking branch 'origin/develop' into feature/geo-search ... Conflicts: Classes/DataProcessing/ProcessorInterface.php Classes/Domain/Index/TcaIndexer/TcaTableService.php	2017-10-20 09:20:04 +02:00
Daniel Siepmann	e321c424b4	Merge pull request #88 from Codappix/bugfix/do-not-fetch-non-existing-db-fields ... BUGFIX: Do not add non existing db columns to fields array	2017-10-14 16:01:39 +02:00
Daniel Siepmann	5d960910f7	Merge pull request #89 from Codappix/bugfix/typos ... BUGFIX: Fix typos in method name and php doc	2017-10-14 15:59:41 +02:00
Daniel Siepmann	5026de0acd	Merge remote-tracking branch 'origin/develop' into bugfix/do-not-fetch-non-existing-db-fields	2017-10-14 15:41:21 +02:00
Daniel Siepmann	67a43e64a5	BUGFIX: Fix typos in method name and php doc	2017-10-14 15:28:50 +02:00
Daniel Siepmann	2c466854b2	BUGFIX: Do not add non existing db columns to fields array ... As TCA might contain columns which do not exist in DB, filter them out.	2017-10-14 15:23:13 +02:00
Daniel Siepmann	6c01abe5a5	BUGFIX: Also handle data processor without configuration	2017-10-14 13:35:44 +02:00
Daniel Siepmann	efeb5d1e07	FEATURE: Add data processing to extension ... Allow integrators / developer to apply data processing concept known from FLUIDTEMPLATE to indexing.	2017-10-14 13:02:48 +02:00
Daniel Siepmann	fafa919f37	WIP|FEATURE: Basic hardcoded implementation	2017-09-16 20:50:03 +02:00
Daniel Siepmann	306f5bef84	BUGFIX: Keep existing arguments in filter mode ... E.g. to support paginate widget arguments.	2017-09-15 23:47:34 +02:00
Daniel Siepmann	9a0d73f1c7	FEATURE: Allow to switch from search to filter mode	2017-09-15 22:26:52 +02:00
Daniel Siepmann	13004e86f2	FEATURE: Allow filter mode by not forcing a search term	2017-09-15 21:54:47 +02:00
Daniel Siepmann	4de1828905	FIX: Fix phpcs issues with annotations	2017-09-15 21:36:52 +02:00
Daniel Siepmann	be75248517	FEATURE: Allow configured filters ... Add new feature to allow pre configured filters. The filters will be applied to all requests.	2017-09-15 21:35:52 +02:00
Daniel Siepmann	b31f315ec4	BUGFIX: Allow iteration / pagination of result items ... Implement necessary logic based on mapped result items, not elastica result items.	2017-09-06 22:45:17 +02:00
Daniel Siepmann	d45d231585	Merge remote-tracking branch 'origin/develop' into feature/cms-8-support	2017-09-05 19:26:09 +02:00
Daniel Siepmann	fcaf1efc79	Merge pull request #82 from Codappix/feature/add-pagination ... FEATURE: Implement necessary logic to support PaginateViewHelper	2017-08-29 09:25:32 +02:00
Daniel Siepmann	efc2fb7da6	BUGFIX: Remove pr issue	2017-08-25 11:46:46 +02:00
Daniel Siepmann	3bb875d99a	Merge pull request #81 from Codappix/feature/support-timing-inheritance-for-pages ... FEATURE: Respect inherited start- and endtime for pages	2017-08-25 11:44:20 +02:00
Daniel Siepmann	fe754964fe	BUGFIX: Fetch record to update	2017-08-21 12:10:34 +02:00
Daniel Siepmann	9617733826	BUGFIX: Fix accessing non existing property	2017-08-15 09:36:25 +02:00
Daniel Siepmann	8b28d5eda6	Merge remote-tracking branch 'origin/develop' into feature/cms-8-support ... Conflicts: Configuration/TypoScript/constants.txt	2017-08-15 09:35:05 +02:00
Daniel Siepmann	040206c95d	FEATURE: Respect further root line cases ... Respect the following situations during indexing: - Page is not reachable due to broken root line. - Page is not reachable due to being below a recycler.	2017-08-15 09:21:04 +02:00
Daniel Siepmann	f311357d0e	TASK: Fix indentation	2017-08-15 08:30:49 +02:00
Daniel Siepmann	bd8ed737e2	Merge remote-tracking branch 'origin/develop' into feature/add-pagination ... Conflicts: Classes/Domain/Search/QueryFactory.php	2017-08-15 08:29:48 +02:00
Daniel Siepmann	ef7c1b680c	Merge pull request #78 from Codappix/feature/small-improvements ... Feature: Small improvements	2017-08-15 08:08:10 +02:00
Daniel Siepmann	416e49026e	TASK: Break line exceeding max line length	2017-08-10 09:05:20 +02:00
Daniel Siepmann	c5766f5b12	BUGFIX: Use fresh query for each creation ... This prevents issues with modifying an build query.	2017-08-10 08:54:36 +02:00
Daniel Siepmann	f7e1bd1cdf	FEATURE: Implement necessary logic to support PaginateViewHelper	2017-08-08 17:19:50 +02:00
Daniel Siepmann	17eb35a92b	FEATURE: Respect inherited start- and endtime for pages ... Do not index records below tables that extend their start- or endtime to their subpages are not accessible due to timing now.	2017-08-08 12:58:01 +02:00
Daniel Siepmann	49a56496c6	TASK: Fix codacy issues ... Break line to not exceed maximum line length. Use imported namespace to shorten line.	2017-08-08 11:54:32 +02:00
Daniel Siepmann	0fa05270d5	Merge branch 'feature/small-improvements' into feature/cms-8-support	2017-08-04 13:40:53 +02:00
Daniel Siepmann	ac78464c03	TASK: Provide more helpful logging	2017-08-04 13:39:48 +02:00
Daniel Siepmann	56ce88b005	TASK: Resolve relations always to array ... Do not resolve to empty string but array to allow same handling for all relations.	2017-08-04 13:39:18 +02:00
Daniel Siepmann	96cfa46056	Merge remote-tracking branch 'origin/develop' into feature/cms-8-support	2017-08-04 13:01:33 +02:00
Daniel Siepmann	d59173ec9a	Merge remote-tracking branch 'origin/develop' into feature/cms-8-support	2017-07-28 11:45:09 +02:00
Daniel Siepmann	da7692b502	TASK: Adjust code accordingly to pr	2017-07-27 16:31:37 +02:00
Daniel Siepmann	36777c700b	Merge remote-tracking branch 'origin/develop' into feature/switch-from-ttcontent-to-pages	2017-07-27 16:26:24 +02:00
Daniel Siepmann	3973d981d4	Merge pull request #71 from Codappix/feature/boosting ... FEATURE: Add possibility to boost certain fields	2017-07-27 16:05:03 +02:00
Daniel Siepmann	0f4186048c	Merge branch 'develop' into feature/boosting	2017-07-27 14:48:43 +02:00
Daniel Siepmann	3771e6f8f9	Merge branch 'develop' into feature/configure-result-size	2017-07-27 14:41:30 +02:00
Daniel Siepmann	441ac7dd84	Merge pull request #59 from Codappix/feature/add-facet-keys ... TASK: Add keys for better access to Facets	2017-07-27 14:28:37 +02:00
Daniel Siepmann	324137711e	Merge pull request #65 from Codappix/feature/allow-exchange-of-limit ... TASK: Allow sub indexer to exchange limit	2017-07-27 14:28:04 +02:00
Daniel Siepmann	f436a02f55	FEATURE: Add field_value_factor support through configuration	2017-07-27 14:20:37 +02:00
Daniel Siepmann	334bb34625	TASK: Cleanup code ... Use get and use an try catch. Receiving null through ifExists will result in an php error.	2017-07-27 13:00:51 +02:00
Daniel Siepmann	f138cd9034	FEATURE: Add possibility to boost certain fields ... Allow configuration via TS to boost certain fields during searching.	2017-07-25 15:38:40 +02:00
Daniel Siepmann	c1cc16efa5	BUGFIX: Fix nun working options due to miss match of ts and es ... As TypoScript does not provide a way to configure key less options, we use a comma separated list and explode them to stay compatible with elasticsearch.	2017-07-25 15:00:25 +02:00
Daniel Siepmann	6462052c9b	FEATURE: Add ngram ... Provide configuration for index. Provide minimum_should_match configuration.	2017-07-25 09:52:17 +02:00
Daniel Siepmann	7722c37ea5	TASK: Check multiple fields for pages to be used as title	2017-07-20 14:22:52 +02:00
Daniel Siepmann	e8a84a8ecc	TASK: Remove temp variable	2017-07-20 13:48:27 +02:00
Daniel Siepmann	b832a6e6b3	TASK: Allow sub indexer to exchange limit ... As long as it's not configurable, allow concrete implementations to exchange. Necessary for one customer at the moment.	2017-07-20 09:48:44 +02:00
Daniel Siepmann	e2c1846d6b	BUGFIX: Allow parent implementation to access content entry ... E.g. it's possible to configure search_abstract to contain the value of any record entry. Still content was not possible as it was set afterwards.	2017-07-18 14:19:32 +02:00
Daniel Siepmann	1030e8d5cf	FEATURE: Make number of search results to fetch configurable	2017-07-18 10:44:39 +02:00
Daniel Siepmann	eafed7fb11	TASK: Add keys for better access to Facets	2017-07-18 09:27:46 +02:00
Daniel Siepmann	b6ab05bac7	FEATURE: Switch from ttcontent to pages ... Also provide search_abstract as new auto added field which is configurable.	2017-07-13 12:51:36 +02:00
Daniel Siepmann	2cd5debf97	BUGFIX: Fix broken getRecord method ... Also add test covering method.	2017-07-07 16:44:57 +02:00
Daniel Siepmann	d61a86f8fe	TASK: Finish TYPO3 CMS 8 update	2017-07-07 16:16:49 +02:00
Daniel Siepmann	cf902dde83	TASK: Make extension more compatible ... Migrate sql to doctrine. Migrate relation resolver to use new API.	2017-07-07 14:44:32 +02:00
Daniel Siepmann	fc3c12fa96	BUGFIX: Allow tests to run without database connection ... Ad TYPO3 Core now makes use of Doctrine, a connection is required to build system where. Therefore we move it to an own method to exchange the execution inside of tests.	2017-07-07 12:19:35 +02:00
Daniel Siepmann	3d90bad58d	Merge remote-tracking branch 'origin/develop' into feature/cms-8-support	2017-07-07 11:58:15 +02:00
Daniel Siepmann	c58e13cdf6	TASK: Rename vendor ... As we move it from private repo to codappix.	2017-07-06 23:48:47 +02:00
Daniel Siepmann	38f9087111	TASK: Finish interface ... To stay compatible with implementation.	2017-07-06 14:13:39 +02:00
Daniel Siepmann	c6a199a7a4	BUGFIX: Fix broken functional test	2017-07-06 14:13:26 +02:00
Daniel Siepmann	05f846a1cf	Update existing unit tests ... Make existing unit tests work with new code base. Also add new tests for new code to existing tests.	2017-07-06 13:53:29 +02:00
Daniel Siepmann	975381cc4a	TASK: Integrate working code ... Copied code from customer installation with working implementation.	2017-07-06 12:03:52 +02:00
Daniel Siepmann	432335c80d	FEATURE: Allow custom indexer ... Adjust code to use defined indexer as FQCN, to allow any class to be used as indexer. Also classes defined by user.	2017-07-04 12:12:36 +02:00
Daniel Siepmann	03a953c13f	TASK: Add unit test covering configuration option ... Add test to cover option to configure user defined additionalWhereClause.	2017-07-04 10:27:03 +02:00
Daniel Siepmann	9d20524706	WIP|TASK: Use new TYPO3 ... Use testing framework configuration. Use new db. Begin with replacement of old TYPO3_DB.	2017-07-04 10:12:47 +02:00
Daniel Siepmann	fde592f2e3	TASK: Adjust configuration for indexing ... * Adjust used configuration in command.	2017-06-29 09:18:31 +02:00
Daniel Siepmann	aa8d7e36e6	TASK: Add test covering index command ... * To enable testing new configuration structure.	2017-06-29 09:13:39 +02:00
Daniel Siepmann	4c7bc8b9f5	Merge branch 'feature/filter' into feature/restructure-configuration	2017-06-29 08:45:36 +02:00