File LRPpreprocessorPOStagger Documentation
Automatically generated with Code Structure Viewer (CS), Project Version: 3o4d 17-November-2020
Copyright © 2020, BAI Research. All Rights Reserved.
File Name: LRPpreprocessorPOStagger.cpp/.hpp
File Description: LRP preprocessor POS tagger
File Function List
-
- generatePOStaggerDatabaseFromWikiDumpText
- generatePOStaggerDatabaseFromWikiDumpText
- addPOStaggerDatabaseEntry1
- addPOStaggerDatabaseEntry2
- addPOStaggerDatabaseEntry3
- addPOStaggerDatabaseEntry4
- generateWikiDumpTextInputFileName
- generatePreprocessorSentenceObjectsFromText
- createPreprocessSentencesBasic
- generateANNexperienceFromPOSambiguityInfoPermutation
- generatePOSambiguityInfoPermutation
- generatePOSambiguityInfoUnambiguousPermutationArray
- determinePOSambiguityInfo
- findWordInWordListAllTypesWithPOSambiguityInfo
- generateANNexperienceFromPOSambiguityInfoPermutationStandalone
- setSentenceContentsWordsUnambiguousPOSindex
File Diagram (functions hierarchy)
Function LRPpreprocessorPOStaggerClass::generatePOStaggerDatabaseFromWikiDumpText()
Function Summary
name | return type | description |
generatePOStaggerDatabaseFromWikiDumpText | bool | generate POS tagger database from wiki dump text |
Function Arguments
name | type | description |
wikiDumpFolderName | string | wiki dump folder name |
useLRP | const bool | use LRP |
Function Reference List
-
- SHAREDvarsClass::getCurrentDirectory
- generatePOStaggerDatabaseFromWikiDumpText
- LRPpreprocessorPOStaggerDatabaseClass::writeDatabaseNeuralNetwork
- LRPpreprocessorPOStaggerDatabaseClass::externalANNtrainEpoch
- LRPpreprocessorPOStaggerDatabaseClass::externalANNtrain
- SHAREDvarsClass::setCurrentDirectory
Function Trace
location | current function being traced |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::generatePOStaggerDatabaseFromWikiDumpText()
Function Summary
name | return type | description |
generatePOStaggerDatabaseFromWikiDumpText | bool | generate POS tagger database from wiki dump text |
Function Arguments
name | type | description |
wikiDumpFolderName | string | wiki dump folder name |
wikiDumpFileBatchIndex | int | wiki dump file batch index |
useLRP | const bool | use LRP |
Function Reference List
-
- LRPpreprocessorWordIdentificationClass::createWordIndexListFromLRPfiles
- generateWikiDumpTextInputFileName
- SHAREDvarsClass::setCurrentDirectory
- generatePreprocessorSentenceObjectsFromText
- LRPpreprocessorPOStaggerDatabaseClass::externalANNgenerateBatchFileName
- LRPpreprocessorPOStaggerDatabaseClass::externalANNgenerateBatchFileName
-
-
- SHAREDvarsClass::convertStringToLowerCase
- findWordInWordListAllTypesWithPOSambiguityInfo
- generatePOSambiguityInfoPermutation
-
- LRPpreprocessorPOStaggerDatabaseClass::determinePOSambiguityInfoIsAmbiguous
-
-
- setSentenceContentsWordsUnambiguousPOSindex
- generatePOSambiguityInfoUnambiguousPermutationArray
- setSentenceContentsWordsUnambiguousPOSindex
- addPOStaggerDatabaseEntry1
- addPOStaggerDatabaseEntry2
- addPOStaggerDatabaseEntry3
- addPOStaggerDatabaseEntry4
- LRPpreprocessorPOStaggerDatabaseClass::writeDatabaseNeuralNetwork
- SHAREDvarsClass::convertIntToString
- SHAREDvarsClass::copyFiles
- LRPpreprocessorPOStaggerDatabaseClass::externalANNgenerateBatchTrainDataExecuteFeed
- LRPpreprocessorPOStaggerDatabaseClass::externalANNgenerateBatchTrainData
Function Trace
location | current function being traced |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::addPOStaggerDatabaseEntry1()
Function Summary
name | return type | description |
addPOStaggerDatabaseEntry1 | bool | add POS tagger database entry 1 |
Function Arguments
name | type | description |
POSambiguityInfoPermutation | const vector<uint64_t>* | POS ambiguity info permutation |
XtrainBatchFileObject | ofstream* | Xtrain batch file object |
Function Reference List
-
- generateANNexperienceFromPOSambiguityInfoPermutation
- LRPpreprocessorPOStaggerDatabaseClass::externalANNgenerateBatchDataExperienceInput
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | addPOStaggerDatabaseEntry1 |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::addPOStaggerDatabaseEntry2()
Function Summary
name | return type | description |
addPOStaggerDatabaseEntry2 | bool | add POS tagger database entry 2 |
Function Arguments
name | type | description |
centreWordPOSambiguityInfo | uint64_t | centre word POS ambiguity info |
POSambiguityInfoPermutation | vector<uint64_t>* | POS ambiguity info permutation |
centreWordUnambiguousPOSindex | uchar | centre word unambiguous POS index |
XtrainBatchFileObject | ofstream* | Xtrain batch file object |
YtrainBatchFileObject | ofstream* | Ytrain batch file object |
Function Reference List
N/A
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | addPOStaggerDatabaseEntry2 |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::addPOStaggerDatabaseEntry3()
Function Summary
name | return type | description |
addPOStaggerDatabaseEntry3 | bool | add POS tagger database entry 3 |
Function Arguments
name | type | description |
centreWordPOSambiguityInfo | uint64_t | centre word POS ambiguity info |
POSambiguityInfoPermutation | vector<uint64_t>* | POS ambiguity info permutation |
centreWordUnambiguousPOSindex | uchar | centre word unambiguous POS index |
currentExperienceInList | ANNexperience** | current experience in list |
Function Reference List
N/A
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | addPOStaggerDatabaseEntry3 |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::addPOStaggerDatabaseEntry4()
Function Summary
name | return type | description |
addPOStaggerDatabaseEntry4 | bool | add POS tagger database entry 4 |
Function Arguments
name | type | description |
centreWordPOSambiguityInfo | uint64_t | centre word POS ambiguity info |
POSambiguityInfoPermutation | vector<uint64_t>* | POS ambiguity info permutation |
centreWordUnambiguousPOSindex | uchar | centre word unambiguous POS index |
numberOfNeuralNetworkFeeds | int64_t* | number of neural network feeds |
Function Reference List
N/A
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | addPOStaggerDatabaseEntry4 |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::generateWikiDumpTextInputFileName()
Function Summary
name | return type | description |
generateWikiDumpTextInputFileName | string | generate wiki dump text input file name |
Function Arguments
name | type | description |
wikiDumpFileBatchIndex | const int | wiki dump file batch index |
Function Reference List
-
- LRPpreprocessorPOStaggerDatabaseClass::generateIntFormatString
- SHAREDvarsClass::convertIntToString
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | generateWikiDumpTextInputFileName |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::generatePreprocessorSentenceObjectsFromText()
Function Summary
name | return type | description |
generatePreprocessorSentenceObjectsFromText | bool | generate preprocessor sentence objects from text |
Function Arguments
name | type | description |
inputFileName | const string | input file name |
firstLRPpreprocessorSentenceInText | LRPpreprocessorSentence* | first LRP preprocessor sentence in text |
useLRP | const bool | use LRP |
Function Reference List
-
- SHAREDvarsClass::getFileContents
- createPreprocessSentencesBasic
- LRPpreprocessorWordReductionClass::initialiseActiveLRPpreprocessorMultiwordReductionTagTextCorrespondenceInfo
- LRPpreprocessorWordReductionClass::setActiveLRPpreprocessorMultiwordReductionTagTextCorrespondenceInfo
- LRPpreprocessorWordReductionClass::parseTextFileAndReduceLanguage
- LRPpreprocessorWordReductionClass::deinitialiseActiveLRPpreprocessorMultiwordReductionTagTextCorrespondenceInfo
- LRPpreprocessorWordClassClass::convertSentenceContentsIndexToEntityIndex
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | generatePreprocessorSentenceObjectsFromText |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::createPreprocessSentencesBasic()
Function Summary
name | return type | description |
createPreprocessSentencesBasic | bool | create preprocess sentences basic |
Function Arguments
name | type | description |
fileContents | string | file contents |
firstLRPpreprocessorSentenceInList | LRPpreprocessorSentence* | first LRP preprocessor sentence in list |
interpretNewLinesAsNewSentences | const bool | interpret new lines as new sentences |
Function Reference List
-
-
- SHAREDvarsClass::charInCharArray
- LRPpreprocessorWordClassClass::isIntrawordPunctuationMark
- SHAREDvarsClass::charInCharArray
- SHAREDvarsClass::charInCharArray
-
- LRPpreprocessorWordClassClass::preprocessorFillCurrentWord
- LRPpreprocessorWordClassClass::preprocessorFillCurrentWord
- SHAREDvarsClass::charInCharArray
- LRPpreprocessorWordClassClass::isIntrawordPunctuationMark
- LRPpreprocessorWordClassClass::generateSentenceWordList
- LRPpreprocessorWordClassClass::generateSentenceWordList
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | createPreprocessSentencesBasic |
LRPpreprocessorPOStagger.hpp | generatePreprocessorSentenceObjectsFromText |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::generateANNexperienceFromPOSambiguityInfoPermutation()
Function Summary
name | return type | description |
generateANNexperienceFromPOSambiguityInfoPermutation | bool | generate ANN experience from POS ambiguity info permutation |
Function Arguments
name | type | description |
POSambiguityInfoPermutation | const vector<uint64_t>* | POS ambiguity info permutation |
centreWordUnambiguousPOSindex | uchar | centre word unambiguous POS index |
currentExperience | ANNexperience* | current experience |
Function Reference List
-
- generateANNexperienceFromPOSambiguityInfoPermutationStandalone
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | generateANNexperienceFromPOSambiguityInfoPermutation |
LRPpreprocessorPOStagger.hpp | addPOStaggerDatabaseEntry1 |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::generatePOSambiguityInfoPermutation()
Function Summary
name | return type | description |
generatePOSambiguityInfoPermutation | bool | generate POS ambiguity info permutation |
Function Arguments
name | type | description |
sentenceContents | vector<LRPpreprocessorPlainTextWord*>* | sentence contents |
wCentre | const int | wCentre |
identifiedEveryWordInDatabasePOSpermutation | bool* | identified every word in database POS permutation |
identifiedEveryWordInDatabasePOSpermutationIsUnambiguous | bool* | identified every word in database POS permutation is unambiguous |
POSambiguityInfoPermutation | vector<uint64_t>* | POS ambiguity info permutation |
Function Reference List
-
-
-
-
- SHAREDvarsClass::setBitValue
- determinePOSambiguityInfo
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | generatePOSambiguityInfoPermutation |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::generatePOSambiguityInfoUnambiguousPermutationArray()
Function Summary
name | return type | description |
generatePOSambiguityInfoUnambiguousPermutationArray | void | generate POS ambiguity info unambiguous permutation array |
Function Arguments
name | type | description |
POSambiguityInfoUnambiguousPermutationArray | vector<vector<uint64_t>*>* | POS ambiguity info unambiguous permutation array |
POSambiguityInfoPermutation | vector<uint64_t>* | POS ambiguity info permutation |
POSambiguityInfoUnambiguousPermutationLocal | vector<uint64_t>* | POS ambiguity info unambiguous permutation local |
wordIndex | int | word index |
Function Reference List
-
-
-
-
- SHAREDvarsClass::getBitValue
- SHAREDvarsClass::setBitValue
- generatePOSambiguityInfoUnambiguousPermutationArray
- generatePOSambiguityInfoUnambiguousPermutationArray
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | generatePOSambiguityInfoUnambiguousPermutationArray |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::determinePOSambiguityInfo()
Function Summary
name | return type | description |
determinePOSambiguityInfo | bool | determine POS ambiguity info |
Function Arguments
name | type | description |
contextWord | constEffective LRPpreprocessorPlainTextWord* | context word |
contextWordPOSambiguityInfo | uint64_t* | context word POS ambiguity info |
contextWordPOSisAmbiguous | bool* | context word POS is ambiguous |
contextWordUnambiguousPOSindex | uchar* | context word unambiguous POS index |
identifiedEveryWordInDatabasePOSpermutation | bool* | identified every word in database POS permutation |
Function Reference List
-
- findWordInWordListAllTypesWithPOSambiguityInfo
- LRPpreprocessorWordClassClass::isMidSentenceUppercaseWordLikelyProperNoun
- SHAREDvarsClass::setBitValue
- LRPpreprocessorWordClassClass::wordIsUpperCase
- SHAREDvarsClass::convertStringToLowerCase
- findWordInWordListAllTypesWithPOSambiguityInfo
- SHAREDvarsClass::convertStringToLowerCase
- findWordInWordListAllTypesWithPOSambiguityInfo
- SHAREDvarsClass::convertStringToLowerCase
- findWordInWordListAllTypesWithPOSambiguityInfo
- LRPpreprocessorWordClassClass::isMidSentenceUppercaseWordLikelyProperNoun
- SHAREDvarsClass::setBitValue
- SHAREDvarsClass::setBitValue
- LRPpreprocessorWordClassClass::isStringNumber
- SHAREDvarsClass::setBitValue
- LRPpreprocessorPOStaggerDatabaseClass::determinePOSambiguityInfoIsAmbiguous
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | determinePOSambiguityInfo |
LRPpreprocessorPOStagger.hpp | generatePOSambiguityInfoPermutation |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::findWordInWordListAllTypesWithPOSambiguityInfo()
Function Summary
name | return type | description |
findWordInWordListAllTypesWithPOSambiguityInfo | bool | find word in word list all types with POS ambiguity info |
Function Arguments
name | type | description |
word | const string | word |
wordFound | LRPpreprocessorMultiwordReductionWord** | word found |
POSambiguityInfoFound | uint64_t* | POS ambiguity info found |
Function Reference List
-
- LRPpreprocessorWordIdentificationClass::getWordListAllTypesWithPOSambiguityInfo
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | findWordInWordListAllTypesWithPOSambiguityInfo |
LRPpreprocessorPOStagger.hpp | determinePOSambiguityInfo |
LRPpreprocessorPOStagger.hpp | generatePOSambiguityInfoPermutation |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::generateANNexperienceFromPOSambiguityInfoPermutationStandalone()
Function Summary
name | return type | description |
generateANNexperienceFromPOSambiguityInfoPermutationStandalone | bool | generate ANN experience from POS ambiguity info permutation standalone |
Function Arguments
name | type | description |
POSambiguityInfoPermutation | const vector<uint64_t>* | POS ambiguity info permutation |
outputNeuronExperienceValue | uchar | output neuron experience value |
currentExperience | ANNexperience* | current experience |
Function Reference List
-
-
-
- SHAREDvarsClass::getBitValue
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | generateANNexperienceFromPOSambiguityInfoPermutationStandalone |
LRPpreprocessorPOStagger.hpp | generateANNexperienceFromPOSambiguityInfoPermutation |
LRPpreprocessorPOStagger.hpp | addPOStaggerDatabaseEntry1 |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)
Function LRPpreprocessorPOStaggerClass::setSentenceContentsWordsUnambiguousPOSindex()
Function Summary
name | return type | description |
setSentenceContentsWordsUnambiguousPOSindex | bool | set sentence contents words unambiguous POS index |
Function Arguments
name | type | description |
sentenceContents | vector<LRPpreprocessorPlainTextWord*>* | sentence contents |
POSambiguityInfoPermutationTemp | const vector<uint64_t>* | POS ambiguity info permutation temp |
Function Reference List
-
-
- LRPpreprocessorPOStaggerDatabaseClass::determinePOSambiguityInfoIsAmbiguous
Function Trace
location | current function being traced |
LRPpreprocessorPOStagger.hpp | setSentenceContentsWordsUnambiguousPOSindex |
LRPmain.hpp | generatePOStaggerDatabaseFromWikiDumpText |
LRPpreprocessorPOStagger.hpp | generatePOStaggerDatabaseFromWikiDumpText |
Trace Diagram (magenta)