SOTDS .DAT Format conforms to ASCII 0-255 only. Unicode is not supported in either .DAT format or within the entire SOTDS Suite.


It should be noted that every database I have created obey to the rules listed below. If you make your own databases from scratch (example converted from CSV), you will have to obey to the same rules to allow proper indexing as well as keeping the .DAT file within the specifications!

Remember that SOTDS is a search engine and not a typographical correct representation of any text indexed by the database, or as search results. This means in human understanding there is no different meaning if your read the word "lucky" instead of "LUCKY". They both means the same. The forced lowercase also helps for indexing complexity and ensuring fastest search possible.


Update August 2017
Decided to remove additional characters as they are basically just blank and useless for searching: 129,141,143,144 and 157 marked in RED below.


--------------------------------------------------------------------------------------------------------------------------------------------------------------


Blue = SOTDS Control Characters: (These has to be present, and not be used by entries).
0, 2, 4, 5, 10 and 13.

Green = Allowed characters: (Basically all human readable used characters in text as well as lowercased letters and all numbers).
32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 128, 130, 131, 132, 133, 134, 135, 136, 137, 139, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 158, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 215, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254 and 255.

Red = Ignored / Not Allowed: (These characters are either unpressable by keyboard, unvalid in text or uppercased characters).
1, 3, 6, 7, 8, 9, 11, 12, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 127, 129, 138, 140, 141, 142, 143, 144, 157, 159, 160, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 216, 217, 218, 219, 220, 221 and 222.

0	00	NUL	Null char
1	01	SOH	Start of Heading
2	02	STX	Start of Text
3	03	ETX	End of Text
4	04	EOT	End of Transmission
5	05	ENQ	Enquiry
6	06	ACK	Acknowledgment
7	07	BEL	Bell
8	08	BS	Back Space
9	09	HT	Horizontal Tab
10	0A	LF	Line Feed
11	0B	VT	Vertical Tab
12	0C	FF	Form Feed
13	0D	CR	Carriage Return
14	0E	SO	Shift Out / X-On
15	0F	SI	Shift In / X-Off
16	10	DLE	Data Line Escape
17	11	DC1	Device Control 1 (oft. XON)
18	12	DC2	Device Control 2
19	13	DC3	Device Control 3 (oft. XOFF)
20	14	DC4	Device Control 4
21	15	NAK	Negative Acknowledgement
22	16	SYN	Synchronous Idle
23	17	ETB	End of Transmit Block
24	18	CAN	Cancel
25	19	EM	End of Medium
26	1A	SUB	Substitute
27	1B	ESC	Escape
28	1C	FS	File Separator
29	1D	GS	Group Separator
30	1E	RS	Record Separator
31	1F	US	Unit Separator
32	20		Space
33	21	!	Exclamation mark
34	22	“	Double quotes (or speech marks)
35	23	#	Number
36	24	$	Dollar
37	25	%	Procenttecken
38	26	&	Ampersand
39	27	‘	Single quote
40	28	(	Open parenthesis (or open bracket)
41	29	)	Close parenthesis (or close bracket)
42	2A	*	Asterisk
43	2B	+	Plus
44	2C	,	Comma
45	2D	-	Hyphen
46	2E	.	Period, dot or full stop
47	2F	/	Slash or divide
48	30	0	Zero
49	31	1	One
50	32	2	Two
51	33	3	Three
52	34	4	Four
53	35	5	Five
54	36	6	Six
55	37	7	Seven
56	38	8	Eight
57	39	9	Nine
58	3A	:	Colon
59	3B	;	Semicolon
60	3C	<	Less than (or open angled bracket)
61	3D	=	Equals
62	3E	>	Greater than (or close angled bracket)
63	3F	?	Question mark
64	40	@	At symbol
65	41	A	Uppercase A
66	42	B	Uppercase B
67	43	C	Uppercase C
68	44	D	Uppercase D
69	45	E	Uppercase E
70	46	F	Uppercase F
71	47	G	Uppercase G
72	48	H	Uppercase H
73	49	I	Uppercase I
74	4A	J	Uppercase J
75	4B	K	Uppercase K
76	4C	L	Uppercase L
77	4D	M	Uppercase M
78	4E	N	Uppercase N
79	4F	O	Uppercase O
80	50	P	Uppercase P
81	51	Q	Uppercase Q
82	52	R	Uppercase R
83	53	S	Uppercase S
84	54	T	Uppercase T
85	55	U	Uppercase U
86	56	V	Uppercase V
87	57	W	Uppercase W
88	58	X	Uppercase X
89	59	Y	Uppercase Y
90	5A	Z	Uppercase Z
91	5B	[	Opening bracket
92	5C	\	Backslash
93	5D	]	Closing bracket
94	5E	^	Caret - circumflex
95	5F	_	Underscore
96	60	`	Grave accent
97	61	a	Lowercase a
98	62	b	Lowercase b
99	63	c	Lowercase c
100	64	d	Lowercase d
101	65	e	Lowercase e
102	66	f	Lowercase f
103	67	g	Lowercase g
104	68	h	Lowercase h
105	69	i	Lowercase i
106	6A	j	Lowercase j
107	6B	k	Lowercase k
108	6C	l	Lowercase l
109	6D	m	Lowercase m
110	6E	n	Lowercase n
111	6F	o	Lowercase o
112	70	p	Lowercase p
113	71	q	Lowercase q
114	72	r	Lowercase r
115	73	s	Lowercase s
116	74	t	Lowercase t
117	75	u	Lowercase u
118	76	v	Lowercase v
119	77	w	Lowercase w
120	78	x	Lowercase x
121	79	y	Lowercase y
122	7A	z	Lowercase z
123	7B	{	Opening brace
124	7C	|	Vertical bar
125	7D	}	Closing brace
126	7E	~	Equivalency sign - tilde
127	7F		Delete
128	80	€	Euro sign
129	81
130	82	‚	Single low-9 quotation mark
131	83	ƒ	Latin small letter f with hook
132	84	„	Double low-9 quotation mark
133	85	…	Horizontal ellipsis
134	86	†	Dagger
135	87	‡	Double dagger
136	88	ˆ	Modifier letter circumflex accent
137	89	‰	Per mille sign
138	8A	Š	Latin capital letter S with caron
139	8B	‹	Single left-pointing angle quotation
140	8C	Œ	Latin capital ligature OE
141	8D
142	8E	Ž	Latin captial letter Z with caron
143	8F
144	90
145	91	‘	Left single quotation mark
146	92	’	Right single quotation mark
147	93	“	Left double quotation mark
148	94	”	Right double quotation mark
149	95	•	Bullet
150	96	–	En dash
151	97	—	Em dash
152	98	˜	Small tilde
153	99	™	Trade mark sign
154	9A	š	Latin small letter S with caron
155	9B	›	Single right-pointing angle quotation mark
156	9C	œ	Latin small ligature oe
157	9D
158	9E	ž	Latin small letter z with caron
159	9F	Ÿ	Latin capital letter Y with diaeresis
160	A0		Non-breaking space
161	A1	¡	Inverted exclamation mark
162	A2	¢	Cent sign
163	A3	£	Pound sign
164	A4	¤	Currency sign
165	A5	¥	Yen sign
166	A6	¦	Pipe, Broken vertical bar
167	A7	§	Section sign
168	A8	¨	Spacing diaeresis - umlaut
169	A9	©	Copyright sign
170	AA	ª	Feminine ordinal indicator
171	AB	«	Left double angle quotes
172	AC	¬	Not sign
173	AD	­	Soft hyphen
174	AE	®	Registered trade mark sign
175	AF	¯	Spacing macron - overline
176	B0	°	Degree sign
177	B1	±	Plus-or-minus sign
178	B2	²	Superscript two - squared
179	B3	³	Superscript three - cubed
180	B4	´	Acute accent - spacing acute
181	B5	µ	Micro sign
182	B6	¶	Pilcrow sign - paragraph sign
183	B7	·	Middle dot - Georgian comma
184	B8	¸	Spacing cedilla
185	B9	¹	Superscript one
186	BA	º	Masculine ordinal indicator
187	BB	»	Right double angle quotes
188	BC	¼	Fraction one quarter
189	BD	½	Fraction one half
190	BE	¾	Fraction three quarters
191	BF	¿	Inverted question mark
192	C0	À	Latin capital letter A with grave
193	C1	Á	Latin capital letter A with acute
194	C2	Â	Latin capital letter A with circumflex
195	C3	Ã	Latin capital letter A with tilde
196	C4	Ä	Latin capital letter A with diaeresis
197	C5	Å	Latin capital letter A with ring above
198	C6	Æ	Latin capital letter AE
199	C7	Ç	Latin capital letter C with cedilla
200	C8	È	Latin capital letter E with grave
201	C9	É	Latin capital letter E with acute
202	CA	Ê	Latin capital letter E with circumflex
203	CB	Ë	Latin capital letter E with diaeresis
204	CC	Ì	Latin capital letter I with grave
205	CD	Í	Latin capital letter I with acute
206	CE	Î	Latin capital letter I with circumflex
207	CF	Ï	Latin capital letter I with diaeresis
208	D0	Ð	Latin capital letter ETH
209	D1	Ñ	Latin capital letter N with tilde
210	D2	Ò	Latin capital letter O with grave
211	D3	Ó	Latin capital letter O with acute
212	D4	Ô	Latin capital letter O with circumflex
213	D5	Õ	Latin capital letter O with tilde
214	D6	Ö	Latin capital letter O with diaeresis
215	D7	×	Multiplication sign
216	D8	Ø	Latin capital letter O with slash
217	D9	Ù	Latin capital letter U with grave
218	DA	Ú	Latin capital letter U with acute
219	DB	Û	Latin capital letter U with circumflex
220	DC	Ü	Latin capital letter U with diaeresis
221	DD	Ý	Latin capital letter Y with acute
222	DE	Þ	Latin capital letter THORN
223	DF	ß	Latin small letter sharp s - ess-zed
224	E0	à	Latin small letter a with grave
225	E1	á	Latin small letter a with acute
226	E2	â	Latin small letter a with circumflex
227	E3	ã	Latin small letter a with tilde
228	E4	ä	Latin small letter a with diaeresis
229	E5	å	Latin small letter a with ring above
230	E6	æ	Latin small letter ae
231	E7	ç	Latin small letter c with cedilla
232	E8	è	Latin small letter e with grave
233	E9	é	Latin small letter e with acute
234	EA	ê	Latin small letter e with circumflex
235	EB	ë	Latin small letter e with diaeresis
236	EC	ì	Latin small letter i with grave
237	ED	í	Latin small letter i with acute
238	EE	î	Latin small letter i with circumflex
239	EF	ï	Latin small letter i with diaeresis
240	F0	ð	Latin small letter eth
241	F1	ñ	Latin small letter n with tilde
242	F2	ò	Latin small letter o with grave
243	F3	ó	Latin small letter o with acute
244	F4	ô	Latin small letter o with circumflex
245	F5	õ	Latin small letter o with tilde
246	F6	ö	Latin small letter o with diaeresis
247	F7	÷	Division sign
248	F8	ø	Latin small letter o with slash
249	F9	ù	Latin small letter u with grave
250	FA	ú	Latin small letter u with acute
251	FB	û	Latin small letter u with circumflex
252	FC	ü	Latin small letter u with diaeresis
253	FD	ý	Latin small letter y with acute
254	FE	þ	Latin small letter thorn
255	FF	ÿ	Latin small letter y with diaeresis