Todos ===== #. Add command that will iterate over all DB entries and remove ones matching the black list rule. E.g. if rule is adjusted in meanwhile. #. Add further widgets. #. Top 404 requests (Collect them to show them). #. Grouped by user agents. #. Move bot detection to another rule. #. Keep indexing those requests, but mark them as bot and separate them in widgets. #. Provide an overview of crawls as widgets. E.g. to allow fine grained robots.txt. #. Add information to Admin Panel. #. Add operating System #. Another Symfony Expression which returns the OS ("Ubuntu", "Macintosh", "Android", "iPhone", "Windows")