feat: support infoquest (#708)

* support infoquest

* support html checker

* support html checker

* change line break format

* change line break format

* change line break format

* change line break format

* change line break format

* change line break format

* change line break format

* change line break format

* Fix several critical issues in the codebase
- Resolve crawler panic by improving error handling
- Fix plan validation to prevent invalid configurations
- Correct InfoQuest crawler JSON conversion logic

* add test for infoquest

* add test for infoquest

* Add InfoQuest introduction to the README

* add test for infoquest

* fix readme for infoquest

* fix readme for infoquest

* resolve the conflict

* resolve the conflict

* resolve the conflict

* Fix formatting of INFOQUEST in SearchEngine enum

* Apply suggestions from code review

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Willem Jiang <143703838+willem-bd@users.noreply.github.com>
Co-authored-by: Willem Jiang <willem.jiang@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

src/config/tools.py

@@ -11,6 +11,7 @@ load_dotenv()
 
 class SearchEngine(enum.Enum):
     TAVILY = "tavily"
+    INFOQUEST = "infoquest"
     DUCKDUCKGO = "duckduckgo"
     BRAVE_SEARCH = "brave_search"
     ARXIV = "arxiv"
@@ -18,10 +19,14 @@ class SearchEngine(enum.Enum):
     WIKIPEDIA = "wikipedia"
 
 
+class CrawlerEngine(enum.Enum):
+    JINA = "jina"
+    INFOQUEST = "infoquest"
+
+
 # Tool configuration
 SELECTED_SEARCH_ENGINE = os.getenv("SEARCH_API", SearchEngine.TAVILY.value)
 
-
 class RAGProvider(enum.Enum):
     DIFY = "dify"
     RAGFLOW = "ragflow"