Previous topic

For Developers

Next topic

Digitization adjustment

This Page

Developers: FrameworkΒΆ

This section of the documentation describes the flow of processing for the ‘general’ digitization. For convenience in the explanations, we use the capital letter ‘X’ to represent the prefix identifying the dictionary. You can think of ‘X’ as ‘skd’ for ‘Sabdakalpadruma’, or as ‘cae’ for ‘Cappeller Sanskrit-English Dictionary’, etc. The names of various files will incorporate that X; for instance, X_orig.txt corresponds, when ‘X’ is ‘skd’, to the particular file ‘skd_orig.txt’.

The various files are available for download by a developer in the downloads section of the Cologne Sanskrit-Lexicon web-site for each dictionary. The data and computer program codes are released under the Creative Commons Attribution Non-Commercial Share Alike license.

Note

If you happen to find some required file unavailable for a particular dictionary, let us know and we will aim to make the file available for download. It is our intent to make available for download everything we have done that a developer might need.

The general flow of processing is shown below. Follow the links to find further details.

Digitization adjustment : Various alterations to the original digitization are made.

X_orig.txt X_orig_utf8.txt X_v0.txt X.txt A B C

Headword identification : Headwords in the digitization X.txt are identified and normalized and transcoded.

X.txt Xhw0.txt Xhw1.txt Xhw2.txt A B C

Construction of xml file : An xml representation is constructed from the digitization and the headwords.

X.txt Xhw2.txt Xhw1.xml

Construction of sqlite : The xml representation is converted into a very simple SQL dataqbase form, which is useful in web displays.

X.xml X.sqlite

Construction of query_dump file : The xml representation is used to generate a file specialized for the advanced search display.

X.xml query_dump.txt

Note

For mw, the Monier-Williams Dictionary (of 1899), only the last two steps of the framework are applicable. See MW Monier-Williams Sanskrit-English Dictionary (Developer notes).