llmtuner.infogetter.wiki ======================== .. py:module:: llmtuner.infogetter.wiki Classes ------- .. autoapisummary:: llmtuner.infogetter.wiki.WikiTalker Module Contents --------------- .. py:class:: WikiTalker(config='') Bases: :py:obj:`llmtuner.infogetter.infobase.InfoBase` Class to retrieve entry information from MediaWiki. .. !! processed by numpydoc !! .. py:method:: list_pages(queryparams={}, get_all_pages=False, get_extended_params=True, write_to_db=False) Function to get pages from mediawiki by handing a dictionary containing. If 'get_all_pages' is True (default False) it will iterate through all paginated pages and return not only the first page, if 'get_extended_params' is True (default), it will also fetch page statistics, if 'write_to_db' is True (default False) it will directly write the entries to the document index. .. !! processed by numpydoc !! .. py:method:: write_to_index(entry, update=True) Store information to DB table .. !! processed by numpydoc !!