187 commits

Author	SHA1	Message	Date
Daniel Siepmann	2b78ffbe96	BUGFIX: Workaround doctrine limitation ... Doctrine will not implode our array, so we have to do	2018-03-15 14:42:41 +01:00
Daniel Siepmann	f3e8dacd4e	TASK: Keep language information for all TYPO3 Versions ... Keep code consistent. Fetch language field for both TYPO3 versions. To make sure we do not mess up, add test case.	2018-03-15 13:59:47 +01:00
Daniel Siepmann	403fd47df0	TASK: Add necessary phpdoc for extbase ... As extbase does not reflect PHP source but phpdoc, we have to define the type to use for mapping as phpdoc.	2018-03-15 11:29:29 +01:00
Daniel Siepmann	218d8d7289	FEATURE: Make content fields configurable ... Allows integrators to configure which fields should be used to produce field "content" for indexed pages. Before only "bodytext" was used. This is now configurable and "header" was added to defaults. Resolves: #134	2018-03-15 09:15:26 +01:00
Daniel Siepmann	a232ae0b36	BUGFIX: Respect page uid of content records ... Do not index content records of all pages while indexing pages in CMS 8.x. We add same logic as for CMS 7.x, we extend the query to only fetch records from current page. Resolves: #135	2018-03-15 08:08:47 +01:00
Daniel Siepmann	835924a8d8	Merge remote-tracking branch 'origin/develop' into feature/support-typo3-7-to-8 ... Conflicts: Tests/Functional/Hooks/DataHandler/ProcessesAllowedTablesTest.php Tests/Unit/Domain/Index/TcaIndexer/TcaTableServiceTest.php	2018-03-14 20:13:03 +01:00
Daniel Siepmann	4d2c8f79ca	TASK: Use imported interface	2018-03-14 20:08:53 +01:00
Daniel Siepmann	b5b0acdc62	TASK: Provide sys_language_uid ... Fetch sys_language_uid from database. Until now we did not fetch system related fields from database. As there is now a RemoveProcessor, integrators are able to remove fields. Also providing this field enables basic multi language support. Relates: #25	2018-03-14 19:56:03 +01:00
Daniel Siepmann	b2a63e9cb0	TASK: Make extension compatible with CMS 7.6	2018-03-13 20:34:56 +01:00
Daniel Siepmann	75335e2bc1	TASK: Do not import unnecessary namespace ... As imported class is on same level as we are, we do not need to import the class.	2018-03-13 11:03:57 +01:00
Daniel Siepmann	ba19537f4e	TASK: Migrate existing 7.6 features ... We had some features in 7.6 support which we didn't merge up yet. Mostly very small bug fixes or more helpful logging and processing of elasticsearch options. But also adding images of content elements while indexing pages.	2018-03-13 11:02:29 +01:00
Daniel Siepmann	a469f63aa6	TASK: Cleanup differences ... We have some small differences between develop and support/76 branch. This differences are just CGL and should not exist.	2018-03-13 10:51:59 +01:00
Daniel Siepmann	fc8017fdf4	TASK: Fix further issues reported by phan	2018-03-08 11:09:28 +01:00
Daniel Siepmann	4da9e86540	TASK: Remove unused use statements	2018-03-08 11:09:07 +01:00
Daniel Siepmann	8d930448e0	TASK: Fix scurtinizer issues	2018-03-06 17:58:19 +01:00
Daniel Siepmann	560597dcff	TASK: Cleanup type annotations and phpstan issues	2018-03-06 17:40:49 +01:00
Daniel Siepmann	88f301f228	FEATURE: Allow range queries for elasticsearch ... Allow "raw" configuration and support "range" type. Also prevent adding boosts if no search term was submitted which can be boosted. Resolves: #119	2018-03-06 16:42:22 +01:00
Daniel Siepmann	3731bcf474	TASK: Fix CGL	2018-03-06 16:39:07 +01:00
Daniel Siepmann	6ac2680211	Merge pull request #101 from Codappix/feature/phpcs-travis ... Feature: Run phpcs on travis	2018-03-06 15:11:46 +01:00
Daniel Siepmann	951edf3871	Merge pull request #122 from Codappix/feature/116-execute-dataprocessor-on-result ... FEATURE: 116 execute dataprocessor on result	2018-03-06 13:47:35 +01:00
Daniel Siepmann	ae51de9041	Merge remote-tracking branch 'origin/develop' into feature/phpcs-travis ... Conflicts: Classes/Hook/DataHandler.php	2018-03-06 13:17:29 +01:00
Daniel Siepmann	5d1e7c41bc	!!!|FEATURE: Pass facet configuration to search service ... Do not limit integrator in possibilities to configure. Therefore previously configure facets for a field need to be adjusted to contain full configuration for elasticsearch. See changelog. Resolves: #120	2018-03-06 12:05:32 +01:00
Daniel Siepmann	cf91251be3	TASK :Add tests for SearchRequest ... Make sure exceptions with helpful messages are thrown if one object is missing when execute is called. Also make sure the expected methods are called.	2018-03-06 09:36:39 +01:00
Daniel Siepmann	79aba3c544	TASK: Add test cases for ResultItem Model ... Check whether all methods work as expected. E.g. we can retrieve data in all ways, but not change anything.	2018-03-06 09:19:09 +01:00
Daniel Siepmann	769fb8237b	TASK: Add data processing to search result ... Search results are now processed through data processing by search service. The result will be a SearchResult model from our domain. Also SearchResult will execute new queries, e.g. from paginate widget, through SearchService to apply data processing again. Remove duplicate stub code to trait, to keep own logic and code clean.	2018-03-06 09:04:47 +01:00
Daniel Siepmann	2998c43ba8	TASK: Refactor data processing ... Use own service to handle data processing. Classes like indexer should not know anything about the structure and how to process the data. Also rename record to data, as we can process just any data in form of an array. Relates: #116	2018-03-01 08:03:51 +01:00
Daniel Siepmann	350f8a52b6	FEATURE: Use extbase for processor instantiation ... This way injects will be resolved inside of processors, enabling developers to inject dependencies. We use inject instead of constructor as indexers mostly will change the constructor and should not need to add the objectmanager. Resolves: #117	2018-02-27 14:47:22 +01:00
Daniel Siepmann	fef2bdac89	Merge pull request #115 from Codappix/feature/112-resolve-relations-for-new-records ... BUGFIX: Allow indexing of new records with their relations	2018-02-23 10:20:58 +01:00
Daniel Siepmann	47b3282034	BUGFIX: Allow indexing of new records with their relations ... Relations were inserted by TYPO3's DataHandler after indexing and were therefore not indexed. We now use a later hook after DataHandler has finished everything, so we know that we can index. As it's not relevant, we do not differentiate between add and update anymore, as both trigger "indexDocument" internal. Resolves: #112	2018-02-22 22:14:44 +01:00
Daniel Siepmann	ebaeaf4c92	TASK: Support PHP 7.0 ... As some (e.g. debian) do not provide PHP 7.1 and we did not use so much features which were introduced in PHP 7.1, we add support for PHP 7.0.	2018-02-22 21:59:13 +01:00
Justus Moroni	c994a32ac1	BUGFIX: Make BackendUtility usable in frontend ... BackendUtility used LanguageService which only works in the backend. Extend BackendUtility and use TSFE instead.	2018-01-29 22:49:29 +01:00
Daniel Siepmann	02ef86b67b	FEATURE: Provide new feature to configure fields to search in ... This enables you to search only in some fields. Also if some fields contain mapping, you can add them in addition to e.g. `_all`.	2017-11-29 18:57:09 +01:00
Daniel Siepmann	b7b783a7fe	TASK: Use Code Sniffer at travis ... This way we need no external service. Each developer can fully run all tests and cgl on local environment. Also this integrated better into IDEs and editors.	2017-11-11 16:52:02 +01:00
Daniel Siepmann	689d8f0c53	Merge pull request #96 from Codappix/feature/refactor-dataprocessing ... !!!|FEATURE: Make data processing available to all indexer	2017-11-10 22:05:49 +01:00
Daniel Siepmann	03d4d7493c	Merge pull request #99 from Codappix/feature/provide-index-deletion-command ... FEATURE: Provide command to delete whole index	2017-11-10 22:05:02 +01:00
Daniel Siepmann	0815eaff6b	BUGFIX: Remove records during update if no longer available ... E.g. update is to deactivate a record. In this case we will not be able to update the record but should delete him instead.	2017-11-10 13:48:53 +01:00
Daniel Siepmann	a3a46f5cb5	FEATURE: Provide command to delete whole index ... This is necessary, e.g. for complete re-indexing.	2017-11-10 13:22:15 +01:00
Daniel Siepmann	e1a14b2f04	!!!|FEATURE: Make data processing available to all indexer ... Before data processing was applied for TCA only, through tca table service. Now it's applied much later in process and in abstract indexer. Therefore all indexer will run data processing if configured.	2017-11-08 21:05:53 +01:00
Daniel Siepmann	43ec410eb5	Merge pull request #93 from Codappix/hotfix/allow-empty-filter ... BUGFIX: Do not remove submitted filter if configured one is empty	2017-11-02 22:41:20 +01:00
Daniel Siepmann	8206a1ec59	BUGFIX: Do not remove submitted filter if configured one is empty ... This will be the case if you add a flexform to the plugin with no value. Then an empty filter is configured and you will not be able to submit a value for this filter.	2017-10-29 17:08:33 +01:00
Daniel Siepmann	c38f7b9d6a	TASK: Move configuration logic into own class ... Also add tests for new code.	2017-10-29 13:44:17 +01:00
Daniel Siepmann	bf91c4a5ba	TASK: Allow fields and sorting to contain a condition ... This way integrators can configure when the sorting and fields should be added.	2017-10-29 12:25:25 +01:00
Daniel Siepmann	07a4fec622	WIP|FEATURE: Allow fields and sorting to be configurable	2017-10-23 16:35:38 +02:00
Daniel Siepmann	b1f81c0d3b	WIP|FEATURE: Add field and sorting ... Sort result by distance and provide distance to result items.	2017-10-22 17:51:04 +02:00
Daniel Siepmann	8d343ee97f	FEATURE: Finish filter configuration for geo_search	2017-10-22 17:34:48 +02:00
Daniel Siepmann	636ef78a14	WIP|TASK: Remove sort and add filter ... As we filter for distance and do not sort.	2017-10-22 11:23:28 +02:00
Daniel Siepmann	3f1c3db2a2	Merge remote-tracking branch 'origin/develop' into feature/geo-search ... Conflicts: Classes/DataProcessing/ProcessorInterface.php Classes/Domain/Index/TcaIndexer/TcaTableService.php	2017-10-20 09:20:04 +02:00
Daniel Siepmann	5026de0acd	Merge remote-tracking branch 'origin/develop' into bugfix/do-not-fetch-non-existing-db-fields	2017-10-14 15:41:21 +02:00
Daniel Siepmann	2c466854b2	BUGFIX: Do not add non existing db columns to fields array ... As TCA might contain columns which do not exist in DB, filter them out.	2017-10-14 15:23:13 +02:00
Daniel Siepmann	6c01abe5a5	BUGFIX: Also handle data processor without configuration	2017-10-14 13:35:44 +02:00
Daniel Siepmann	efeb5d1e07	FEATURE: Add data processing to extension ... Allow integrators / developer to apply data processing concept known from FLUIDTEMPLATE to indexing.	2017-10-14 13:02:48 +02:00
Daniel Siepmann	fafa919f37	WIP|FEATURE: Basic hardcoded implementation	2017-09-16 20:50:03 +02:00
Daniel Siepmann	13004e86f2	FEATURE: Allow filter mode by not forcing a search term	2017-09-15 21:54:47 +02:00
Daniel Siepmann	4de1828905	FIX: Fix phpcs issues with annotations	2017-09-15 21:36:52 +02:00
Daniel Siepmann	be75248517	FEATURE: Allow configured filters ... Add new feature to allow pre configured filters. The filters will be applied to all requests.	2017-09-15 21:35:52 +02:00
Daniel Siepmann	d45d231585	Merge remote-tracking branch 'origin/develop' into feature/cms-8-support	2017-09-05 19:26:09 +02:00
Daniel Siepmann	fcaf1efc79	Merge pull request #82 from Codappix/feature/add-pagination ... FEATURE: Implement necessary logic to support PaginateViewHelper	2017-08-29 09:25:32 +02:00
Daniel Siepmann	efc2fb7da6	BUGFIX: Remove pr issue	2017-08-25 11:46:46 +02:00
Daniel Siepmann	3bb875d99a	Merge pull request #81 from Codappix/feature/support-timing-inheritance-for-pages ... FEATURE: Respect inherited start- and endtime for pages	2017-08-25 11:44:20 +02:00
Daniel Siepmann	fe754964fe	BUGFIX: Fetch record to update	2017-08-21 12:10:34 +02:00
Daniel Siepmann	9617733826	BUGFIX: Fix accessing non existing property	2017-08-15 09:36:25 +02:00
Daniel Siepmann	8b28d5eda6	Merge remote-tracking branch 'origin/develop' into feature/cms-8-support ... Conflicts: Configuration/TypoScript/constants.txt	2017-08-15 09:35:05 +02:00
Daniel Siepmann	040206c95d	FEATURE: Respect further root line cases ... Respect the following situations during indexing: - Page is not reachable due to broken root line. - Page is not reachable due to being below a recycler.	2017-08-15 09:21:04 +02:00
Daniel Siepmann	f311357d0e	TASK: Fix indentation	2017-08-15 08:30:49 +02:00
Daniel Siepmann	bd8ed737e2	Merge remote-tracking branch 'origin/develop' into feature/add-pagination ... Conflicts: Classes/Domain/Search/QueryFactory.php	2017-08-15 08:29:48 +02:00
Daniel Siepmann	ef7c1b680c	Merge pull request #78 from Codappix/feature/small-improvements ... Feature: Small improvements	2017-08-15 08:08:10 +02:00
Daniel Siepmann	416e49026e	TASK: Break line exceeding max line length	2017-08-10 09:05:20 +02:00
Daniel Siepmann	c5766f5b12	BUGFIX: Use fresh query for each creation ... This prevents issues with modifying an build query.	2017-08-10 08:54:36 +02:00
Daniel Siepmann	f7e1bd1cdf	FEATURE: Implement necessary logic to support PaginateViewHelper	2017-08-08 17:19:50 +02:00
Daniel Siepmann	17eb35a92b	FEATURE: Respect inherited start- and endtime for pages ... Do not index records below tables that extend their start- or endtime to their subpages are not accessible due to timing now.	2017-08-08 12:58:01 +02:00
Daniel Siepmann	49a56496c6	TASK: Fix codacy issues ... Break line to not exceed maximum line length. Use imported namespace to shorten line.	2017-08-08 11:54:32 +02:00
Daniel Siepmann	0fa05270d5	Merge branch 'feature/small-improvements' into feature/cms-8-support	2017-08-04 13:40:53 +02:00
Daniel Siepmann	56ce88b005	TASK: Resolve relations always to array ... Do not resolve to empty string but array to allow same handling for all relations.	2017-08-04 13:39:18 +02:00
Daniel Siepmann	96cfa46056	Merge remote-tracking branch 'origin/develop' into feature/cms-8-support	2017-08-04 13:01:33 +02:00
Daniel Siepmann	d59173ec9a	Merge remote-tracking branch 'origin/develop' into feature/cms-8-support	2017-07-28 11:45:09 +02:00
Daniel Siepmann	da7692b502	TASK: Adjust code accordingly to pr	2017-07-27 16:31:37 +02:00
Daniel Siepmann	36777c700b	Merge remote-tracking branch 'origin/develop' into feature/switch-from-ttcontent-to-pages	2017-07-27 16:26:24 +02:00
Daniel Siepmann	3973d981d4	Merge pull request #71 from Codappix/feature/boosting ... FEATURE: Add possibility to boost certain fields	2017-07-27 16:05:03 +02:00
Daniel Siepmann	0f4186048c	Merge branch 'develop' into feature/boosting	2017-07-27 14:48:43 +02:00
Daniel Siepmann	3771e6f8f9	Merge branch 'develop' into feature/configure-result-size	2017-07-27 14:41:30 +02:00
Daniel Siepmann	324137711e	Merge pull request #65 from Codappix/feature/allow-exchange-of-limit ... TASK: Allow sub indexer to exchange limit	2017-07-27 14:28:04 +02:00
Daniel Siepmann	f436a02f55	FEATURE: Add field_value_factor support through configuration	2017-07-27 14:20:37 +02:00
Daniel Siepmann	334bb34625	TASK: Cleanup code ... Use get and use an try catch. Receiving null through ifExists will result in an php error.	2017-07-27 13:00:51 +02:00
Daniel Siepmann	f138cd9034	FEATURE: Add possibility to boost certain fields ... Allow configuration via TS to boost certain fields during searching.	2017-07-25 15:38:40 +02:00
Daniel Siepmann	6462052c9b	FEATURE: Add ngram ... Provide configuration for index. Provide minimum_should_match configuration.	2017-07-25 09:52:17 +02:00
Daniel Siepmann	7722c37ea5	TASK: Check multiple fields for pages to be used as title	2017-07-20 14:22:52 +02:00
Daniel Siepmann	e8a84a8ecc	TASK: Remove temp variable	2017-07-20 13:48:27 +02:00
Daniel Siepmann	b832a6e6b3	TASK: Allow sub indexer to exchange limit ... As long as it's not configurable, allow concrete implementations to exchange. Necessary for one customer at the moment.	2017-07-20 09:48:44 +02:00
Daniel Siepmann	e2c1846d6b	BUGFIX: Allow parent implementation to access content entry ... E.g. it's possible to configure search_abstract to contain the value of any record entry. Still content was not possible as it was set afterwards.	2017-07-18 14:19:32 +02:00
Daniel Siepmann	1030e8d5cf	FEATURE: Make number of search results to fetch configurable	2017-07-18 10:44:39 +02:00
Daniel Siepmann	b6ab05bac7	FEATURE: Switch from ttcontent to pages ... Also provide search_abstract as new auto added field which is configurable.	2017-07-13 12:51:36 +02:00
Daniel Siepmann	2cd5debf97	BUGFIX: Fix broken getRecord method ... Also add test covering method.	2017-07-07 16:44:57 +02:00
Daniel Siepmann	d61a86f8fe	TASK: Finish TYPO3 CMS 8 update	2017-07-07 16:16:49 +02:00
Daniel Siepmann	cf902dde83	TASK: Make extension more compatible ... Migrate sql to doctrine. Migrate relation resolver to use new API.	2017-07-07 14:44:32 +02:00
Daniel Siepmann	fc3c12fa96	BUGFIX: Allow tests to run without database connection ... Ad TYPO3 Core now makes use of Doctrine, a connection is required to build system where. Therefore we move it to an own method to exchange the execution inside of tests.	2017-07-07 12:19:35 +02:00
Daniel Siepmann	3d90bad58d	Merge remote-tracking branch 'origin/develop' into feature/cms-8-support	2017-07-07 11:58:15 +02:00
Daniel Siepmann	c58e13cdf6	TASK: Rename vendor ... As we move it from private repo to codappix.	2017-07-06 23:48:47 +02:00
Daniel Siepmann	05f846a1cf	Update existing unit tests ... Make existing unit tests work with new code base. Also add new tests for new code to existing tests.	2017-07-06 13:53:29 +02:00
Daniel Siepmann	975381cc4a	TASK: Integrate working code ... Copied code from customer installation with working implementation.	2017-07-06 12:03:52 +02:00
Daniel Siepmann	432335c80d	FEATURE: Allow custom indexer ... Adjust code to use defined indexer as FQCN, to allow any class to be used as indexer. Also classes defined by user.	2017-07-04 12:12:36 +02:00