]> code.delx.au - gnu-emacs/blob - man/mule.texi
(Mode Line Mouse): Mention mode-line-highlight effect.
[gnu-emacs] / man / mule.texi
1 @c This is part of the Emacs manual.
2 @c Copyright (C) 1997, 1999, 2000, 2001, 2005 Free Software Foundation, Inc.
3 @c See file emacs.texi for copying conditions.
4 @node International, Major Modes, Frames, Top
5 @chapter International Character Set Support
6 @cindex MULE
7 @cindex international scripts
8 @cindex multibyte characters
9 @cindex encoding of characters
10
11 @cindex Celtic
12 @cindex Chinese
13 @cindex Cyrillic
14 @cindex Czech
15 @cindex Devanagari
16 @cindex Hindi
17 @cindex Marathi
18 @cindex Ethiopic
19 @cindex German
20 @cindex Greek
21 @cindex Hebrew
22 @cindex IPA
23 @cindex Japanese
24 @cindex Korean
25 @cindex Lao
26 @cindex Latin
27 @cindex Polish
28 @cindex Romanian
29 @cindex Slovak
30 @cindex Slovenian
31 @cindex Thai
32 @cindex Tibetan
33 @cindex Turkish
34 @cindex Vietnamese
35 @cindex Dutch
36 @cindex Spanish
37 Emacs supports a wide variety of international character sets,
38 including European variants of the Latin alphabet, as well as Chinese,
39 Cyrillic, Devanagari (Hindi and Marathi), Ethiopic, Greek, Hebrew, IPA,
40 Japanese, Korean, Lao, Thai, Tibetan, and Vietnamese scripts. These features
41 have been merged from the modified version of Emacs known as MULE (for
42 ``MULti-lingual Enhancement to GNU Emacs'')
43
44 Emacs also supports various encodings of these characters used by
45 other internationalized software, such as word processors and mailers.
46
47 Emacs allows editing text with international characters by supporting
48 all the related activities:
49
50 @itemize @bullet
51 @item
52 You can visit files with non-@acronym{ASCII} characters, save non-@acronym{ASCII} text, and
53 pass non-@acronym{ASCII} text between Emacs and programs it invokes (such as
54 compilers, spell-checkers, and mailers). Setting your language
55 environment (@pxref{Language Environments}) takes care of setting up the
56 coding systems and other options for a specific language or culture.
57 Alternatively, you can specify how Emacs should encode or decode text
58 for each command; see @ref{Specify Coding}.
59
60 @item
61 You can display non-@acronym{ASCII} characters encoded by the various scripts.
62 This works by using appropriate fonts on X and similar graphics
63 displays (@pxref{Defining Fontsets}), and by sending special codes to
64 text-only displays (@pxref{Specify Coding}). If some characters are
65 displayed incorrectly, refer to @ref{Undisplayable Characters}, which
66 describes possible problems and explains how to solve them.
67
68 @item
69 You can insert non-@acronym{ASCII} characters or search for them. To do that,
70 you can specify an input method (@pxref{Select Input Method}) suitable
71 for your language, or use the default input method set up when you set
72 your language environment. (Emacs input methods are part of the Leim
73 package, which must be installed for you to be able to use them.) If
74 your keyboard can produce non-@acronym{ASCII} characters, you can select an
75 appropriate keyboard coding system (@pxref{Specify Coding}), and Emacs
76 will accept those characters. Latin-1 characters can also be input by
77 using the @kbd{C-x 8} prefix, see @ref{Single-Byte Character Support,
78 C-x 8}. On X Window systems, your locale should be set to an
79 appropriate value to make sure Emacs interprets keyboard input
80 correctly; see @ref{Language Environments, locales}.
81 @end itemize
82
83 The rest of this chapter describes these issues in detail.
84
85 @menu
86 * International Chars:: Basic concepts of multibyte characters.
87 * Enabling Multibyte:: Controlling whether to use multibyte characters.
88 * Language Environments:: Setting things up for the language you use.
89 * Input Methods:: Entering text characters not on your keyboard.
90 * Select Input Method:: Specifying your choice of input methods.
91 * Multibyte Conversion:: How single-byte characters convert to multibyte.
92 * Coding Systems:: Character set conversion when you read and
93 write files, and so on.
94 * Recognize Coding:: How Emacs figures out which conversion to use.
95 * Specify Coding:: Various ways to choose which conversion to use.
96 * Fontsets:: Fontsets are collections of fonts
97 that cover the whole spectrum of characters.
98 * Defining Fontsets:: Defining a new fontset.
99 * Undisplayable Characters:: When characters don't display.
100 * Single-Byte Character Support:: You can pick one European character set
101 to use without multibyte characters.
102 * Charsets:: How Emacs groups its internal character codes.
103 @end menu
104
105 @node International Chars
106 @section Introduction to International Character Sets
107
108 The users of international character sets and scripts have established
109 many more-or-less standard coding systems for storing files. Emacs
110 internally uses a single multibyte character encoding, so that it can
111 intermix characters from all these scripts in a single buffer or string.
112 This encoding represents each non-@acronym{ASCII} character as a sequence of bytes
113 in the range 0200 through 0377. Emacs translates between the multibyte
114 character encoding and various other coding systems when reading and
115 writing files, when exchanging data with subprocesses, and (in some
116 cases) in the @kbd{C-q} command (@pxref{Multibyte Conversion}).
117
118 @kindex C-h h
119 @findex view-hello-file
120 @cindex undisplayable characters
121 @cindex @samp{?} in display
122 The command @kbd{C-h h} (@code{view-hello-file}) displays the file
123 @file{etc/HELLO}, which shows how to say ``hello'' in many languages.
124 This illustrates various scripts. If some characters can't be
125 displayed on your terminal, they appear as @samp{?} or as hollow boxes
126 (@pxref{Undisplayable Characters}).
127
128 Keyboards, even in the countries where these character sets are used,
129 generally don't have keys for all the characters in them. So Emacs
130 supports various @dfn{input methods}, typically one for each script or
131 language, to make it convenient to type them.
132
133 @kindex C-x RET
134 The prefix key @kbd{C-x @key{RET}} is used for commands that pertain
135 to multibyte characters, coding systems, and input methods.
136
137 @node Enabling Multibyte
138 @section Enabling Multibyte Characters
139
140 @cindex turn multibyte support on or off
141 You can enable or disable multibyte character support, either for
142 Emacs as a whole, or for a single buffer. When multibyte characters are
143 disabled in a buffer, then each byte in that buffer represents a
144 character, even codes 0200 through 0377. The old features for
145 supporting the European character sets, ISO Latin-1 and ISO Latin-2,
146 work as they did in Emacs 19 and also work for the other ISO 8859
147 character sets.
148
149 However, there is no need to turn off multibyte character support to
150 use ISO Latin; the Emacs multibyte character set includes all the
151 characters in these character sets, and Emacs can translate
152 automatically to and from the ISO codes.
153
154 By default, Emacs starts in multibyte mode, because that allows you to
155 use all the supported languages and scripts without limitations.
156
157 To edit a particular file in unibyte representation, visit it using
158 @code{find-file-literally}. @xref{Visiting}. To convert a buffer in
159 multibyte representation into a single-byte representation of the same
160 characters, the easiest way is to save the contents in a file, kill the
161 buffer, and find the file again with @code{find-file-literally}. You
162 can also use @kbd{C-x @key{RET} c}
163 (@code{universal-coding-system-argument}) and specify @samp{raw-text} as
164 the coding system with which to find or save a file. @xref{Specify
165 Coding}. Finding a file as @samp{raw-text} doesn't disable format
166 conversion, uncompression and auto mode selection as
167 @code{find-file-literally} does.
168
169 @vindex enable-multibyte-characters
170 @vindex default-enable-multibyte-characters
171 To turn off multibyte character support by default, start Emacs with
172 the @samp{--unibyte} option (@pxref{Initial Options}), or set the
173 environment variable @env{EMACS_UNIBYTE}. You can also customize
174 @code{enable-multibyte-characters} or, equivalently, directly set the
175 variable @code{default-enable-multibyte-characters} to @code{nil} in
176 your init file to have basically the same effect as @samp{--unibyte}.
177
178 @findex toggle-enable-multibyte-characters
179 To convert a unibyte session to a multibyte session, set
180 @code{default-enable-multibyte-characters} to @code{t}. Buffers which
181 were created in the unibyte session before you turn on multibyte support
182 will stay unibyte. You can turn on multibyte support in a specific
183 buffer by invoking the command @code{toggle-enable-multibyte-characters}
184 in that buffer.
185
186 @cindex Lisp files, and multibyte operation
187 @cindex multibyte operation, and Lisp files
188 @cindex unibyte operation, and Lisp files
189 @cindex init file, and non-@acronym{ASCII} characters
190 @cindex environment variables, and non-@acronym{ASCII} characters
191 With @samp{--unibyte}, multibyte strings are not created during
192 initialization from the values of environment variables,
193 @file{/etc/passwd} entries etc.@: that contain non-@acronym{ASCII} 8-bit
194 characters.
195
196 Emacs normally loads Lisp files as multibyte, regardless of whether
197 you used @samp{--unibyte}. This includes the Emacs initialization file,
198 @file{.emacs}, and the initialization files of Emacs packages such as
199 Gnus. However, you can specify unibyte loading for a particular Lisp
200 file, by putting @w{@samp{-*-unibyte: t;-*-}} in a comment on the first
201 line (@pxref{File Variables}). Then that file is always loaded as
202 unibyte text, even if you did not start Emacs with @samp{--unibyte}.
203 The motivation for these conventions is that it is more reliable to
204 always load any particular Lisp file in the same way. However, you can
205 load a Lisp file as unibyte, on any one occasion, by typing @kbd{C-x
206 @key{RET} c raw-text @key{RET}} immediately before loading it.
207
208 The mode line indicates whether multibyte character support is enabled
209 in the current buffer. If it is, there are two or more characters (most
210 often two dashes) before the colon near the beginning of the mode line.
211 When multibyte characters are not enabled, just one dash precedes the
212 colon.
213
214 @node Language Environments
215 @section Language Environments
216 @cindex language environments
217
218 All supported character sets are supported in Emacs buffers whenever
219 multibyte characters are enabled; there is no need to select a
220 particular language in order to display its characters in an Emacs
221 buffer. However, it is important to select a @dfn{language environment}
222 in order to set various defaults. The language environment really
223 represents a choice of preferred script (more or less) rather than a
224 choice of language.
225
226 The language environment controls which coding systems to recognize
227 when reading text (@pxref{Recognize Coding}). This applies to files,
228 incoming mail, netnews, and any other text you read into Emacs. It may
229 also specify the default coding system to use when you create a file.
230 Each language environment also specifies a default input method.
231
232 @findex set-language-environment
233 @vindex current-language-environment
234 To select a language environment, you can customize the variable
235 @code{current-language-environment} or use the command @kbd{M-x
236 set-language-environment}. It makes no difference which buffer is
237 current when you use this command, because the effects apply globally to
238 the Emacs session. The supported language environments include:
239
240 @cindex Euro sign
241 @cindex UTF-8
242 @quotation
243 Chinese-BIG5, Chinese-CNS, Chinese-GB, Cyrillic-ALT, Cyrillic-ISO,
244 Cyrillic-KOI8, Czech, Devanagari, Dutch, English, Ethiopic, German,
245 Greek, Hebrew, IPA, Japanese, Korean, Lao, Latin-1, Latin-2, Latin-3,
246 Latin-4, Latin-5, Latin-8 (Celtic), Latin-9 (updated Latin-1, with the
247 Euro sign), Polish, Romanian, Slovak, Slovenian, Spanish, Thai, Tibetan,
248 Turkish, UTF-8 (for a setup which prefers Unicode characters and files
249 encoded in UTF-8), and Vietnamese.
250 @end quotation
251
252 @cindex fonts for various scripts
253 @cindex Intlfonts package, installation
254 To display the script(s) used by your language environment on a
255 graphical display, you need to have a suitable font. If some of the
256 characters appear as empty boxes, you should install the GNU Intlfonts
257 package, which includes fonts for all supported scripts.@footnote{If
258 you run Emacs on X, you need to inform the X server about the location
259 of the newly installed fonts with the following commands:
260
261 @example
262 xset fp+ /usr/local/share/emacs/fonts
263 xset fp rehash
264 @end example
265 }
266 @xref{Fontsets}, for more details about setting up your fonts.
267
268 @findex set-locale-environment
269 @vindex locale-language-names
270 @vindex locale-charset-language-names
271 @cindex locales
272 Some operating systems let you specify the character-set locale you
273 are using by setting the locale environment variables @env{LC_ALL},
274 @env{LC_CTYPE}, or @env{LANG}.@footnote{If more than one of these is
275 set, the first one that is nonempty specifies your locale for this
276 purpose.} During startup, Emacs looks up your character-set locale's
277 name in the system locale alias table, matches its canonical name
278 against entries in the value of the variables
279 @code{locale-charset-language-names} and @code{locale-language-names},
280 and selects the corresponding language environment if a match is found.
281 (The former variable overrides the latter.) It also adjusts the display
282 table and terminal coding system, the locale coding system, the
283 preferred coding system as needed for the locale, and---last but not
284 least---the way Emacs decodes non-@acronym{ASCII} characters sent by your keyboard.
285
286 If you modify the @env{LC_ALL}, @env{LC_CTYPE}, or @env{LANG}
287 environment variables while running Emacs, you may want to invoke the
288 @code{set-locale-environment} function afterwards to readjust the
289 language environment from the new locale.
290
291 @vindex locale-preferred-coding-systems
292 The @code{set-locale-environment} function normally uses the preferred
293 coding system established by the language environment to decode system
294 messages. But if your locale matches an entry in the variable
295 @code{locale-preferred-coding-systems}, Emacs uses the corresponding
296 coding system instead. For example, if the locale @samp{ja_JP.PCK}
297 matches @code{japanese-shift-jis} in
298 @code{locale-preferred-coding-systems}, Emacs uses that encoding even
299 though it might normally use @code{japanese-iso-8bit}.
300
301 You can override the language environment chosen at startup with
302 explicit use of the command @code{set-language-environment}, or with
303 customization of @code{current-language-environment} in your init
304 file.
305
306 @kindex C-h L
307 @findex describe-language-environment
308 To display information about the effects of a certain language
309 environment @var{lang-env}, use the command @kbd{C-h L @var{lang-env}
310 @key{RET}} (@code{describe-language-environment}). This tells you which
311 languages this language environment is useful for, and lists the
312 character sets, coding systems, and input methods that go with it. It
313 also shows some sample text to illustrate scripts used in this language
314 environment. By default, this command describes the chosen language
315 environment.
316
317 @vindex set-language-environment-hook
318 You can customize any language environment with the normal hook
319 @code{set-language-environment-hook}. The command
320 @code{set-language-environment} runs that hook after setting up the new
321 language environment. The hook functions can test for a specific
322 language environment by checking the variable
323 @code{current-language-environment}. This hook is where you should
324 put non-default settings for specific language environment, such as
325 coding systems for keyboard input and terminal output, the default
326 input method, etc.
327
328 @vindex exit-language-environment-hook
329 Before it starts to set up the new language environment,
330 @code{set-language-environment} first runs the hook
331 @code{exit-language-environment-hook}. This hook is useful for undoing
332 customizations that were made with @code{set-language-environment-hook}.
333 For instance, if you set up a special key binding in a specific language
334 environment using @code{set-language-environment-hook}, you should set
335 up @code{exit-language-environment-hook} to restore the normal binding
336 for that key.
337
338 @node Input Methods
339 @section Input Methods
340
341 @cindex input methods
342 An @dfn{input method} is a kind of character conversion designed
343 specifically for interactive input. In Emacs, typically each language
344 has its own input method; sometimes several languages which use the same
345 characters can share one input method. A few languages support several
346 input methods.
347
348 The simplest kind of input method works by mapping @acronym{ASCII} letters
349 into another alphabet; this allows you to use one other alphabet
350 instead of @acronym{ASCII}. The Greek and Russian input methods
351 work this way.
352
353 A more powerful technique is composition: converting sequences of
354 characters into one letter. Many European input methods use composition
355 to produce a single non-@acronym{ASCII} letter from a sequence that consists of a
356 letter followed by accent characters (or vice versa). For example, some
357 methods convert the sequence @kbd{a'} into a single accented letter.
358 These input methods have no special commands of their own; all they do
359 is compose sequences of printing characters.
360
361 The input methods for syllabic scripts typically use mapping followed
362 by composition. The input methods for Thai and Korean work this way.
363 First, letters are mapped into symbols for particular sounds or tone
364 marks; then, sequences of these which make up a whole syllable are
365 mapped into one syllable sign.
366
367 Chinese and Japanese require more complex methods. In Chinese input
368 methods, first you enter the phonetic spelling of a Chinese word (in
369 input method @code{chinese-py}, among others), or a sequence of
370 portions of the character (input methods @code{chinese-4corner} and
371 @code{chinese-sw}, and others). One input sequence typically
372 corresponds to many possible Chinese characters. You select the one
373 you mean using keys such as @kbd{C-f}, @kbd{C-b}, @kbd{C-n},
374 @kbd{C-p}, and digits, which have special meanings in this situation.
375
376 The possible characters are conceptually arranged in several rows,
377 with each row holding up to 10 alternatives. Normally, Emacs displays
378 just one row at a time, in the echo area; @code{(@var{i}/@var{j})}
379 appears at the beginning, to indicate that this is the @var{i}th row
380 out of a total of @var{j} rows. Type @kbd{C-n} or @kbd{C-p} to
381 display the next row or the previous row.
382
383 Type @kbd{C-f} and @kbd{C-b} to move forward and backward among
384 the alternatives in the current row. As you do this, Emacs highlights
385 the current alternative with a special color; type @code{C-@key{SPC}}
386 to select the current alternative and use it as input. The
387 alternatives in the row are also numbered; the number appears before
388 the alternative. Typing a digit @var{n} selects the @var{n}th
389 alternative of the current row and uses it as input.
390
391 @key{TAB} in these Chinese input methods displays a buffer showing
392 all the possible characters at once; then clicking @kbd{Mouse-2} on
393 one of them selects that alternative. The keys @kbd{C-f}, @kbd{C-b},
394 @kbd{C-n}, @kbd{C-p}, and digits continue to work as usual, but they
395 do the highlighting in the buffer showing the possible characters,
396 rather than in the echo area.
397
398 In Japanese input methods, first you input a whole word using
399 phonetic spelling; then, after the word is in the buffer, Emacs
400 converts it into one or more characters using a large dictionary. One
401 phonetic spelling corresponds to a number of different Japanese words;
402 to select one of them, use @kbd{C-n} and @kbd{C-p} to cycle through
403 the alternatives.
404
405 Sometimes it is useful to cut off input method processing so that the
406 characters you have just entered will not combine with subsequent
407 characters. For example, in input method @code{latin-1-postfix}, the
408 sequence @kbd{e '} combines to form an @samp{e} with an accent. What if
409 you want to enter them as separate characters?
410
411 One way is to type the accent twice; this is a special feature for
412 entering the separate letter and accent. For example, @kbd{e ' '} gives
413 you the two characters @samp{e'}. Another way is to type another letter
414 after the @kbd{e}---something that won't combine with that---and
415 immediately delete it. For example, you could type @kbd{e e @key{DEL}
416 '} to get separate @samp{e} and @samp{'}.
417
418 Another method, more general but not quite as easy to type, is to use
419 @kbd{C-\ C-\} between two characters to stop them from combining. This
420 is the command @kbd{C-\} (@code{toggle-input-method}) used twice.
421 @ifinfo
422 @xref{Select Input Method}.
423 @end ifinfo
424
425 @cindex incremental search, input method interference
426 @kbd{C-\ C-\} is especially useful inside an incremental search,
427 because it stops waiting for more characters to combine, and starts
428 searching for what you have already entered.
429
430 To find out how to input the character after point using the current
431 input method, type @kbd{C-u C-x =}. @xref{Position Info}.
432
433 @vindex input-method-verbose-flag
434 @vindex input-method-highlight-flag
435 The variables @code{input-method-highlight-flag} and
436 @code{input-method-verbose-flag} control how input methods explain
437 what is happening. If @code{input-method-highlight-flag} is
438 non-@code{nil}, the partial sequence is highlighted in the buffer (for
439 most input methods---some disable this feature). If
440 @code{input-method-verbose-flag} is non-@code{nil}, the list of
441 possible characters to type next is displayed in the echo area (but
442 not when you are in the minibuffer).
443
444 @node Select Input Method
445 @section Selecting an Input Method
446
447 @table @kbd
448 @item C-\
449 Enable or disable use of the selected input method.
450
451 @item C-x @key{RET} C-\ @var{method} @key{RET}
452 Select a new input method for the current buffer.
453
454 @item C-h I @var{method} @key{RET}
455 @itemx C-h C-\ @var{method} @key{RET}
456 @findex describe-input-method
457 @kindex C-h I
458 @kindex C-h C-\
459 Describe the input method @var{method} (@code{describe-input-method}).
460 By default, it describes the current input method (if any). This
461 description should give you the full details of how to use any
462 particular input method.
463
464 @item M-x list-input-methods
465 Display a list of all the supported input methods.
466 @end table
467
468 @findex set-input-method
469 @vindex current-input-method
470 @kindex C-x RET C-\
471 To choose an input method for the current buffer, use @kbd{C-x
472 @key{RET} C-\} (@code{set-input-method}). This command reads the
473 input method name from the minibuffer; the name normally starts with the
474 language environment that it is meant to be used with. The variable
475 @code{current-input-method} records which input method is selected.
476
477 @findex toggle-input-method
478 @kindex C-\
479 Input methods use various sequences of @acronym{ASCII} characters to stand for
480 non-@acronym{ASCII} characters. Sometimes it is useful to turn off the input
481 method temporarily. To do this, type @kbd{C-\}
482 (@code{toggle-input-method}). To reenable the input method, type
483 @kbd{C-\} again.
484
485 If you type @kbd{C-\} and you have not yet selected an input method,
486 it prompts for you to specify one. This has the same effect as using
487 @kbd{C-x @key{RET} C-\} to specify an input method.
488
489 When invoked with a numeric argument, as in @kbd{C-u C-\},
490 @code{toggle-input-method} always prompts you for an input method,
491 suggesting the most recently selected one as the default.
492
493 @vindex default-input-method
494 Selecting a language environment specifies a default input method for
495 use in various buffers. When you have a default input method, you can
496 select it in the current buffer by typing @kbd{C-\}. The variable
497 @code{default-input-method} specifies the default input method
498 (@code{nil} means there is none).
499
500 In some language environments, which support several different input
501 methods, you might want to use an input method different from the
502 default chosen by @code{set-language-environment}. You can instruct
503 Emacs to select a different default input method for a certain
504 language environment, if you wish, by using
505 @code{set-language-environment-hook} (@pxref{Language Environments,
506 set-language-environment-hook}). For example:
507
508 @lisp
509 (defun my-chinese-setup ()
510 "Set up my private Chinese environment."
511 (if (equal current-language-environment "Chinese-GB")
512 (setq default-input-method "chinese-tonepy")))
513 (add-hook 'set-language-environment-hook 'my-chinese-setup)
514 @end lisp
515
516 @noindent
517 This sets the default input method to be @code{chinese-tonepy}
518 whenever you choose a Chinese-GB language environment.
519
520 @findex quail-set-keyboard-layout
521 Some input methods for alphabetic scripts work by (in effect)
522 remapping the keyboard to emulate various keyboard layouts commonly used
523 for those scripts. How to do this remapping properly depends on your
524 actual keyboard layout. To specify which layout your keyboard has, use
525 the command @kbd{M-x quail-set-keyboard-layout}.
526
527 @findex quail-show-key
528 You can use the command @kbd{M-x quail-show-key} to show what key
529 (or key sequence) to type in order to input the character following
530 point, using the selected keyboard layout.
531
532 @findex list-input-methods
533 To display a list of all the supported input methods, type @kbd{M-x
534 list-input-methods}. The list gives information about each input
535 method, including the string that stands for it in the mode line.
536
537 @node Multibyte Conversion
538 @section Unibyte and Multibyte Non-@acronym{ASCII} characters
539
540 When multibyte characters are enabled, character codes 0240 (octal)
541 through 0377 (octal) are not really legitimate in the buffer. The valid
542 non-@acronym{ASCII} printing characters have codes that start from 0400.
543
544 If you type a self-inserting character in the range 0240 through
545 0377, or if you use @kbd{C-q} to insert one, Emacs assumes you
546 intended to use one of the ISO Latin-@var{n} character sets, and
547 converts it to the Emacs code representing that Latin-@var{n}
548 character. You select @emph{which} ISO Latin character set to use
549 through your choice of language environment
550 @iftex
551 (see above).
552 @end iftex
553 @ifinfo
554 (@pxref{Language Environments}).
555 @end ifinfo
556 If you do not specify a choice, the default is Latin-1.
557
558 If you insert a character in the range 0200 through 0237, which
559 forms the @code{eight-bit-control} character set, it is inserted
560 literally. You should normally avoid doing this since buffers
561 containing such characters have to be written out in either the
562 @code{emacs-mule} or @code{raw-text} coding system, which is usually
563 not what you want.
564
565 @node Coding Systems
566 @section Coding Systems
567 @cindex coding systems
568
569 Users of various languages have established many more-or-less standard
570 coding systems for representing them. Emacs does not use these coding
571 systems internally; instead, it converts from various coding systems to
572 its own system when reading data, and converts the internal coding
573 system to other coding systems when writing data. Conversion is
574 possible in reading or writing files, in sending or receiving from the
575 terminal, and in exchanging data with subprocesses.
576
577 Emacs assigns a name to each coding system. Most coding systems are
578 used for one language, and the name of the coding system starts with the
579 language name. Some coding systems are used for several languages;
580 their names usually start with @samp{iso}. There are also special
581 coding systems @code{no-conversion}, @code{raw-text} and
582 @code{emacs-mule} which do not convert printing characters at all.
583
584 @cindex international files from DOS/Windows systems
585 A special class of coding systems, collectively known as
586 @dfn{codepages}, is designed to support text encoded by MS-Windows and
587 MS-DOS software. To use any of these systems, you need to create it
588 with @kbd{M-x codepage-setup}. @xref{MS-DOS and MULE}. After
589 creating the coding system for the codepage, you can use it as any
590 other coding system. For example, to visit a file encoded in codepage
591 850, type @kbd{C-x @key{RET} c cp850 @key{RET} C-x C-f @var{filename}
592 @key{RET}}.
593
594 In addition to converting various representations of non-@acronym{ASCII}
595 characters, a coding system can perform end-of-line conversion. Emacs
596 handles three different conventions for how to separate lines in a file:
597 newline, carriage-return linefeed, and just carriage-return.
598
599 @table @kbd
600 @item C-h C @var{coding} @key{RET}
601 Describe coding system @var{coding}.
602
603 @item C-h C @key{RET}
604 Describe the coding systems currently in use.
605
606 @item M-x list-coding-systems
607 Display a list of all the supported coding systems.
608 @end table
609
610 @kindex C-h C
611 @findex describe-coding-system
612 The command @kbd{C-h C} (@code{describe-coding-system}) displays
613 information about particular coding systems. You can specify a coding
614 system name as the argument; alternatively, with an empty argument, it
615 describes the coding systems currently selected for various purposes,
616 both in the current buffer and as the defaults, and the priority list
617 for recognizing coding systems (@pxref{Recognize Coding}).
618
619 @findex list-coding-systems
620 To display a list of all the supported coding systems, type @kbd{M-x
621 list-coding-systems}. The list gives information about each coding
622 system, including the letter that stands for it in the mode line
623 (@pxref{Mode Line}).
624
625 @cindex end-of-line conversion
626 @cindex MS-DOS end-of-line conversion
627 @cindex Macintosh end-of-line conversion
628 Each of the coding systems that appear in this list---except for
629 @code{no-conversion}, which means no conversion of any kind---specifies
630 how and whether to convert printing characters, but leaves the choice of
631 end-of-line conversion to be decided based on the contents of each file.
632 For example, if the file appears to use the sequence carriage-return
633 linefeed to separate lines, DOS end-of-line conversion will be used.
634
635 Each of the listed coding systems has three variants which specify
636 exactly what to do for end-of-line conversion:
637
638 @table @code
639 @item @dots{}-unix
640 Don't do any end-of-line conversion; assume the file uses
641 newline to separate lines. (This is the convention normally used
642 on Unix and GNU systems.)
643
644 @item @dots{}-dos
645 Assume the file uses carriage-return linefeed to separate lines, and do
646 the appropriate conversion. (This is the convention normally used on
647 Microsoft systems.@footnote{It is also specified for MIME @samp{text/*}
648 bodies and in other network transport contexts. It is different
649 from the SGML reference syntax record-start/record-end format which
650 Emacs doesn't support directly.})
651
652 @item @dots{}-mac
653 Assume the file uses carriage-return to separate lines, and do the
654 appropriate conversion. (This is the convention normally used on the
655 Macintosh system.)
656 @end table
657
658 These variant coding systems are omitted from the
659 @code{list-coding-systems} display for brevity, since they are entirely
660 predictable. For example, the coding system @code{iso-latin-1} has
661 variants @code{iso-latin-1-unix}, @code{iso-latin-1-dos} and
662 @code{iso-latin-1-mac}.
663
664 The coding system @code{raw-text} is good for a file which is mainly
665 @acronym{ASCII} text, but may contain byte values above 127 which are not meant to
666 encode non-@acronym{ASCII} characters. With @code{raw-text}, Emacs copies those
667 byte values unchanged, and sets @code{enable-multibyte-characters} to
668 @code{nil} in the current buffer so that they will be interpreted
669 properly. @code{raw-text} handles end-of-line conversion in the usual
670 way, based on the data encountered, and has the usual three variants to
671 specify the kind of end-of-line conversion to use.
672
673 In contrast, the coding system @code{no-conversion} specifies no
674 character code conversion at all---none for non-@acronym{ASCII} byte values and
675 none for end of line. This is useful for reading or writing binary
676 files, tar files, and other files that must be examined verbatim. It,
677 too, sets @code{enable-multibyte-characters} to @code{nil}.
678
679 The easiest way to edit a file with no conversion of any kind is with
680 the @kbd{M-x find-file-literally} command. This uses
681 @code{no-conversion}, and also suppresses other Emacs features that
682 might convert the file contents before you see them. @xref{Visiting}.
683
684 The coding system @code{emacs-mule} means that the file contains
685 non-@acronym{ASCII} characters stored with the internal Emacs encoding. It
686 handles end-of-line conversion based on the data encountered, and has
687 the usual three variants to specify the kind of end-of-line conversion.
688
689 @node Recognize Coding
690 @section Recognizing Coding Systems
691
692 Emacs tries to recognize which coding system to use for a given text
693 as an integral part of reading that text. (This applies to files
694 being read, output from subprocesses, text from X selections, etc.)
695 Emacs can select the right coding system automatically most of the
696 time---once you have specified your preferences.
697
698 Some coding systems can be recognized or distinguished by which byte
699 sequences appear in the data. However, there are coding systems that
700 cannot be distinguished, not even potentially. For example, there is no
701 way to distinguish between Latin-1 and Latin-2; they use the same byte
702 values with different meanings.
703
704 Emacs handles this situation by means of a priority list of coding
705 systems. Whenever Emacs reads a file, if you do not specify the coding
706 system to use, Emacs checks the data against each coding system,
707 starting with the first in priority and working down the list, until it
708 finds a coding system that fits the data. Then it converts the file
709 contents assuming that they are represented in this coding system.
710
711 The priority list of coding systems depends on the selected language
712 environment (@pxref{Language Environments}). For example, if you use
713 French, you probably want Emacs to prefer Latin-1 to Latin-2; if you use
714 Czech, you probably want Latin-2 to be preferred. This is one of the
715 reasons to specify a language environment.
716
717 @findex prefer-coding-system
718 However, you can alter the coding system priority list in detail
719 with the command @kbd{M-x prefer-coding-system}. This command reads
720 the name of a coding system from the minibuffer, and adds it to the
721 front of the priority list, so that it is preferred to all others. If
722 you use this command several times, each use adds one element to the
723 front of the priority list.
724
725 If you use a coding system that specifies the end-of-line conversion
726 type, such as @code{iso-8859-1-dos}, what this means is that Emacs
727 should attempt to recognize @code{iso-8859-1} with priority, and should
728 use DOS end-of-line conversion when it does recognize @code{iso-8859-1}.
729
730 @vindex file-coding-system-alist
731 Sometimes a file name indicates which coding system to use for the
732 file. The variable @code{file-coding-system-alist} specifies this
733 correspondence. There is a special function
734 @code{modify-coding-system-alist} for adding elements to this list. For
735 example, to read and write all @samp{.txt} files using the coding system
736 @code{china-iso-8bit}, you can execute this Lisp expression:
737
738 @smallexample
739 (modify-coding-system-alist 'file "\\.txt\\'" 'china-iso-8bit)
740 @end smallexample
741
742 @noindent
743 The first argument should be @code{file}, the second argument should be
744 a regular expression that determines which files this applies to, and
745 the third argument says which coding system to use for these files.
746
747 @vindex inhibit-eol-conversion
748 @cindex DOS-style end-of-line display
749 Emacs recognizes which kind of end-of-line conversion to use based on
750 the contents of the file: if it sees only carriage-returns, or only
751 carriage-return linefeed sequences, then it chooses the end-of-line
752 conversion accordingly. You can inhibit the automatic use of
753 end-of-line conversion by setting the variable @code{inhibit-eol-conversion}
754 to non-@code{nil}. If you do that, DOS-style files will be displayed
755 with the @samp{^M} characters visible in the buffer; some people
756 prefer this to the more subtle @samp{(DOS)} end-of-line type
757 indication near the left edge of the mode line (@pxref{Mode Line,
758 eol-mnemonic}).
759
760 @vindex inhibit-iso-escape-detection
761 @cindex escape sequences in files
762 By default, the automatic detection of coding system is sensitive to
763 escape sequences. If Emacs sees a sequence of characters that begin
764 with an escape character, and the sequence is valid as an ISO-2022
765 code, that tells Emacs to use one of the ISO-2022 encodings to decode
766 the file.
767
768 However, there may be cases that you want to read escape sequences
769 in a file as is. In such a case, you can set the variable
770 @code{inhibit-iso-escape-detection} to non-@code{nil}. Then the code
771 detection ignores any escape sequences, and never uses an ISO-2022
772 encoding. The result is that all escape sequences become visible in
773 the buffer.
774
775 The default value of @code{inhibit-iso-escape-detection} is
776 @code{nil}. We recommend that you not change it permanently, only for
777 one specific operation. That's because many Emacs Lisp source files
778 in the Emacs distribution contain non-@acronym{ASCII} characters encoded in the
779 coding system @code{iso-2022-7bit}, and they won't be
780 decoded correctly when you visit those files if you suppress the
781 escape sequence detection.
782
783 @vindex coding
784 You can specify the coding system for a particular file using the
785 @w{@samp{-*-@dots{}-*-}} construct at the beginning of a file, or a
786 local variables list at the end (@pxref{File Variables}). You do this
787 by defining a value for the ``variable'' named @code{coding}. Emacs
788 does not really have a variable @code{coding}; instead of setting a
789 variable, this uses the specified coding system for the file. For
790 example, @samp{-*-mode: C; coding: latin-1;-*-} specifies use of the
791 Latin-1 coding system, as well as C mode. When you specify the coding
792 explicitly in the file, that overrides
793 @code{file-coding-system-alist}.
794
795 @vindex auto-coding-alist
796 @vindex auto-coding-regexp-alist
797 @vindex auto-coding-functions
798 The variables @code{auto-coding-alist},
799 @code{auto-coding-regexp-alist} and @code{auto-coding-functions} are
800 the strongest way to specify the coding system for certain patterns of
801 file names, or for files containing certain patterns; these variables
802 even override @samp{-*-coding:-*-} tags in the file itself. Emacs
803 uses @code{auto-coding-alist} for tar and archive files, to prevent it
804 from being confused by a @samp{-*-coding:-*-} tag in a member of the
805 archive and thinking it applies to the archive file as a whole.
806 Likewise, Emacs uses @code{auto-coding-regexp-alist} to ensure that
807 RMAIL files, whose names in general don't match any particular
808 pattern, are decoded correctly. One of the builtin
809 @code{auto-coding-functions} detects the encoding for XML files.
810
811 If Emacs recognizes the encoding of a file incorrectly, you can
812 reread the file using the correct coding system by typing @kbd{C-x
813 @key{RET} c @var{coding-system} @key{RET} M-x revert-buffer
814 @key{RET}}. To see what coding system Emacs actually used to decode
815 the file, look at the coding system mnemonic letter near the left edge
816 of the mode line (@pxref{Mode Line}), or type @kbd{C-h C @key{RET}}.
817
818 @findex unify-8859-on-decoding-mode
819 The command @code{unify-8859-on-decoding-mode} enables a mode that
820 ``unifies'' the Latin alphabets when decoding text. This works by
821 converting all non-@acronym{ASCII} Latin-@var{n} characters to either Latin-1 or
822 Unicode characters. This way it is easier to use various
823 Latin-@var{n} alphabets together. In a future Emacs version we hope
824 to move towards full Unicode support and complete unification of
825 character sets.
826
827 @vindex buffer-file-coding-system
828 Once Emacs has chosen a coding system for a buffer, it stores that
829 coding system in @code{buffer-file-coding-system} and uses that coding
830 system, by default, for operations that write from this buffer into a
831 file. This includes the commands @code{save-buffer} and
832 @code{write-region}. If you want to write files from this buffer using
833 a different coding system, you can specify a different coding system for
834 the buffer using @code{set-buffer-file-coding-system} (@pxref{Specify
835 Coding}).
836
837 You can insert any possible character into any Emacs buffer, but
838 most coding systems can only handle some of the possible characters.
839 This means that it is possible for you to insert characters that
840 cannot be encoded with the coding system that will be used to save the
841 buffer. For example, you could start with an @acronym{ASCII} file and insert a
842 few Latin-1 characters into it, or you could edit a text file in
843 Polish encoded in @code{iso-8859-2} and add some Russian words to it.
844 When you save the buffer, Emacs cannot use the current value of
845 @code{buffer-file-coding-system}, because the characters you added
846 cannot be encoded by that coding system.
847
848 When that happens, Emacs tries the most-preferred coding system (set
849 by @kbd{M-x prefer-coding-system} or @kbd{M-x
850 set-language-environment}), and if that coding system can safely
851 encode all of the characters in the buffer, Emacs uses it, and stores
852 its value in @code{buffer-file-coding-system}. Otherwise, Emacs
853 displays a list of coding systems suitable for encoding the buffer's
854 contents, and asks you to choose one of those coding systems.
855
856 If you insert the unsuitable characters in a mail message, Emacs
857 behaves a bit differently. It additionally checks whether the
858 most-preferred coding system is recommended for use in MIME messages;
859 if not, Emacs tells you that the most-preferred coding system is
860 not recommended and prompts you for another coding system. This is so
861 you won't inadvertently send a message encoded in a way that your
862 recipient's mail software will have difficulty decoding. (If you do
863 want to use the most-preferred coding system, you can still type its
864 name in response to the question.)
865
866 @vindex sendmail-coding-system
867 When you send a message with Mail mode (@pxref{Sending Mail}), Emacs has
868 four different ways to determine the coding system to use for encoding
869 the message text. It tries the buffer's own value of
870 @code{buffer-file-coding-system}, if that is non-@code{nil}. Otherwise,
871 it uses the value of @code{sendmail-coding-system}, if that is
872 non-@code{nil}. The third way is to use the default coding system for
873 new files, which is controlled by your choice of language environment,
874 if that is non-@code{nil}. If all of these three values are @code{nil},
875 Emacs encodes outgoing mail using the Latin-1 coding system.
876
877 @vindex rmail-decode-mime-charset
878 When you get new mail in Rmail, each message is translated
879 automatically from the coding system it is written in, as if it were a
880 separate file. This uses the priority list of coding systems that you
881 have specified. If a MIME message specifies a character set, Rmail
882 obeys that specification, unless @code{rmail-decode-mime-charset} is
883 @code{nil}.
884
885 @vindex rmail-file-coding-system
886 For reading and saving Rmail files themselves, Emacs uses the coding
887 system specified by the variable @code{rmail-file-coding-system}. The
888 default value is @code{nil}, which means that Rmail files are not
889 translated (they are read and written in the Emacs internal character
890 code).
891
892 @node Specify Coding
893 @section Specifying a Coding System
894
895 In cases where Emacs does not automatically choose the right coding
896 system, you can use these commands to specify one:
897
898 @table @kbd
899 @item C-x @key{RET} f @var{coding} @key{RET}
900 Use coding system @var{coding} for saving or revisiting the visited
901 file in the current buffer.
902
903 @item C-x @key{RET} c @var{coding} @key{RET}
904 Specify coding system @var{coding} for the immediately following
905 command.
906
907 @item C-x @key{RET} r @var{coding} @key{RET}
908 Revisit the current file using the coding system @var{coding}.
909
910 @item C-x @key{RET} k @var{coding} @key{RET}
911 Use coding system @var{coding} for keyboard input.
912
913 @item C-x @key{RET} t @var{coding} @key{RET}
914 Use coding system @var{coding} for terminal output.
915
916 @item C-x @key{RET} p @var{input-coding} @key{RET} @var{output-coding} @key{RET}
917 Use coding systems @var{input-coding} and @var{output-coding} for
918 subprocess input and output in the current buffer.
919
920 @item C-x @key{RET} x @var{coding} @key{RET}
921 Use coding system @var{coding} for transferring selections to and from
922 other programs through the window system.
923
924 @item C-x @key{RET} F @var{coding} @key{RET}
925 Use coding system @var{coding} for encoding and decoding file
926 @emph{names}. This affects the use of non-ASCII characters in file
927 names. It has no effect on reading and writing the @emph{contents} of
928 files.
929
930 @item C-x @key{RET} X @var{coding} @key{RET}
931 Use coding system @var{coding} for transferring @emph{one}
932 selection---the next one---to or from the window system.
933
934 @item M-x recode-region
935 Convert the region from a previous coding system to a new one.
936 @end table
937
938 @kindex C-x RET f
939 @findex set-buffer-file-coding-system
940 The command @kbd{C-x @key{RET} f}
941 (@code{set-buffer-file-coding-system}) sets the file coding system for
942 the current buffer---in other words, it says which coding system to
943 use when saving or reverting the visited file. You specify which
944 coding system using the minibuffer. If you specify a coding system
945 that cannot handle all of the characters in the buffer, Emacs warns
946 you about the troublesome characters when you actually save the
947 buffer.
948
949 @kindex C-x RET c
950 @findex universal-coding-system-argument
951 Another way to specify the coding system for a file is when you visit
952 the file. First use the command @kbd{C-x @key{RET} c}
953 (@code{universal-coding-system-argument}); this command uses the
954 minibuffer to read a coding system name. After you exit the minibuffer,
955 the specified coding system is used for @emph{the immediately following
956 command}.
957
958 So if the immediately following command is @kbd{C-x C-f}, for example,
959 it reads the file using that coding system (and records the coding
960 system for when you later save the file). Or if the immediately following
961 command is @kbd{C-x C-w}, it writes the file using that coding system.
962 When you specify the coding system for saving in this way, instead
963 of with @kbd{C-x @key{RET} f}, there is no warning if the buffer
964 contains characters that the coding system cannot handle.
965
966 Other file commands affected by a specified coding system include
967 @kbd{C-x C-i} and @kbd{C-x C-v}, as well as the other-window variants
968 of @kbd{C-x C-f}. @kbd{C-x @key{RET} c} also affects commands that
969 start subprocesses, including @kbd{M-x shell} (@pxref{Shell}).
970
971 If the immediately following command does not use the coding system,
972 then @kbd{C-x @key{RET} c} ultimately has no effect.
973
974 An easy way to visit a file with no conversion is with the @kbd{M-x
975 find-file-literally} command. @xref{Visiting}.
976
977 @vindex default-buffer-file-coding-system
978 The variable @code{default-buffer-file-coding-system} specifies the
979 choice of coding system to use when you create a new file. It applies
980 when you find a new file, and when you create a buffer and then save it
981 in a file. Selecting a language environment typically sets this
982 variable to a good choice of default coding system for that language
983 environment.
984
985 @kindex C-x RET r
986 @findex revert-buffer-with-coding-system
987 If you visit a file with a wrong coding system, you can correct this
988 with @kbd{C-x @key{RET} r} (@code{revert-buffer-with-coding-system}).
989 This visits the current file again, using a coding system you specify.
990
991 @kindex C-x RET t
992 @findex set-terminal-coding-system
993 The command @kbd{C-x @key{RET} t} (@code{set-terminal-coding-system})
994 specifies the coding system for terminal output. If you specify a
995 character code for terminal output, all characters output to the
996 terminal are translated into that coding system.
997
998 This feature is useful for certain character-only terminals built to
999 support specific languages or character sets---for example, European
1000 terminals that support one of the ISO Latin character sets. You need to
1001 specify the terminal coding system when using multibyte text, so that
1002 Emacs knows which characters the terminal can actually handle.
1003
1004 By default, output to the terminal is not translated at all, unless
1005 Emacs can deduce the proper coding system from your terminal type or
1006 your locale specification (@pxref{Language Environments}).
1007
1008 @kindex C-x RET k
1009 @findex set-keyboard-coding-system
1010 @vindex keyboard-coding-system
1011 The command @kbd{C-x @key{RET} k} (@code{set-keyboard-coding-system})
1012 or the variable @code{keyboard-coding-system} specifies the coding
1013 system for keyboard input. Character-code translation of keyboard
1014 input is useful for terminals with keys that send non-@acronym{ASCII}
1015 graphic characters---for example, some terminals designed for ISO
1016 Latin-1 or subsets of it.
1017
1018 By default, keyboard input is translated based on your system locale
1019 setting. If your terminal does not really support the encoding
1020 implied by your locale (for example, if you find it inserts a
1021 non-@acronym{ASCII} character if you type @kbd{M-i}), you will need to set
1022 @code{keyboard-coding-system} to @code{nil} to turn off encoding.
1023 You can do this by putting
1024
1025 @lisp
1026 (set-keyboard-coding-system nil)
1027 @end lisp
1028
1029 @noindent
1030 in your @file{~/.emacs} file.
1031
1032 There is a similarity between using a coding system translation for
1033 keyboard input, and using an input method: both define sequences of
1034 keyboard input that translate into single characters. However, input
1035 methods are designed to be convenient for interactive use by humans, and
1036 the sequences that are translated are typically sequences of @acronym{ASCII}
1037 printing characters. Coding systems typically translate sequences of
1038 non-graphic characters.
1039
1040 @kindex C-x RET x
1041 @kindex C-x RET X
1042 @findex set-selection-coding-system
1043 @findex set-next-selection-coding-system
1044 The command @kbd{C-x @key{RET} x} (@code{set-selection-coding-system})
1045 specifies the coding system for sending selected text to the window
1046 system, and for receiving the text of selections made in other
1047 applications. This command applies to all subsequent selections, until
1048 you override it by using the command again. The command @kbd{C-x
1049 @key{RET} X} (@code{set-next-selection-coding-system}) specifies the
1050 coding system for the next selection made in Emacs or read by Emacs.
1051
1052 @kindex C-x RET p
1053 @findex set-buffer-process-coding-system
1054 The command @kbd{C-x @key{RET} p} (@code{set-buffer-process-coding-system})
1055 specifies the coding system for input and output to a subprocess. This
1056 command applies to the current buffer; normally, each subprocess has its
1057 own buffer, and thus you can use this command to specify translation to
1058 and from a particular subprocess by giving the command in the
1059 corresponding buffer.
1060
1061 The default for translation of process input and output depends on the
1062 current language environment.
1063
1064 @findex recode-region
1065 If a piece of text has already been inserted into a buffer using the
1066 wrong coding system, you can decode it again using @kbd{M-x
1067 recode-region}. This prompts you for the old coding system and the
1068 desired coding system, and acts on the text in the region.
1069
1070 @vindex file-name-coding-system
1071 @cindex file names with non-@acronym{ASCII} characters
1072 @findex set-file-name-coding-system
1073 @kindex C-x @key{RET} F
1074 The variable @code{file-name-coding-system} specifies a coding
1075 system to use for encoding file names. If you set the variable to a
1076 coding system name (as a Lisp symbol or a string), Emacs encodes file
1077 names using that coding system for all file operations. This makes it
1078 possible to use non-@acronym{ASCII} characters in file names---or, at
1079 least, those non-@acronym{ASCII} characters which the specified coding
1080 system can encode. Use @kbd{C-x @key{RET} F}
1081 (@code{set-file-name-coding-system}) to specify this interactively.
1082
1083 If @code{file-name-coding-system} is @code{nil}, Emacs uses a default
1084 coding system determined by the selected language environment. In the
1085 default language environment, any non-@acronym{ASCII} characters in file names are
1086 not encoded specially; they appear in the file system using the internal
1087 Emacs representation.
1088
1089 @strong{Warning:} if you change @code{file-name-coding-system} (or the
1090 language environment) in the middle of an Emacs session, problems can
1091 result if you have already visited files whose names were encoded using
1092 the earlier coding system and cannot be encoded (or are encoded
1093 differently) under the new coding system. If you try to save one of
1094 these buffers under the visited file name, saving may use the wrong file
1095 name, or it may get an error. If such a problem happens, use @kbd{C-x
1096 C-w} to specify a new file name for that buffer.
1097
1098 @findex recode-file-name
1099 If a mistake occurs when encoding a file name, use the command
1100 command @kbd{M-x recode-file-name} to change the file name's coding
1101 system. This prompts for an existing file name, its old coding
1102 system, and the coding system to which you wish to convert.
1103
1104 @vindex locale-coding-system
1105 @cindex decoding non-@acronym{ASCII} keyboard input on X
1106 The variable @code{locale-coding-system} specifies a coding system
1107 to use when encoding and decoding system strings such as system error
1108 messages and @code{format-time-string} formats and time stamps. That
1109 coding system is also used for decoding non-@acronym{ASCII} keyboard input on X
1110 Window systems. You should choose a coding system that is compatible
1111 with the underlying system's text representation, which is normally
1112 specified by one of the environment variables @env{LC_ALL},
1113 @env{LC_CTYPE}, and @env{LANG}. (The first one, in the order
1114 specified above, whose value is nonempty is the one that determines
1115 the text representation.)
1116
1117 @node Fontsets
1118 @section Fontsets
1119 @cindex fontsets
1120
1121 A font for X typically defines shapes for a single alphabet or script.
1122 Therefore, displaying the entire range of scripts that Emacs supports
1123 requires a collection of many fonts. In Emacs, such a collection is
1124 called a @dfn{fontset}. A fontset is defined by a list of fonts, each
1125 assigned to handle a range of character codes.
1126
1127 Each fontset has a name, like a font. The available X fonts are
1128 defined by the X server; fontsets, however, are defined within Emacs
1129 itself. Once you have defined a fontset, you can use it within Emacs by
1130 specifying its name, anywhere that you could use a single font. Of
1131 course, Emacs fontsets can use only the fonts that the X server
1132 supports; if certain characters appear on the screen as hollow boxes,
1133 this means that the fontset in use for them has no font for those
1134 characters.@footnote{The Emacs installation instructions have information on
1135 additional font support.}
1136
1137 Emacs creates two fontsets automatically: the @dfn{standard fontset}
1138 and the @dfn{startup fontset}. The standard fontset is most likely to
1139 have fonts for a wide variety of non-@acronym{ASCII} characters; however, this is
1140 not the default for Emacs to use. (By default, Emacs tries to find a
1141 font that has bold and italic variants.) You can specify use of the
1142 standard fontset with the @samp{-fn} option, or with the @samp{Font} X
1143 resource (@pxref{Font X}). For example,
1144
1145 @example
1146 emacs -fn fontset-standard
1147 @end example
1148
1149 A fontset does not necessarily specify a font for every character
1150 code. If a fontset specifies no font for a certain character, or if it
1151 specifies a font that does not exist on your system, then it cannot
1152 display that character properly. It will display that character as an
1153 empty box instead.
1154
1155 @node Defining Fontsets
1156 @section Defining fontsets
1157
1158 @vindex standard-fontset-spec
1159 @cindex standard fontset
1160 Emacs creates a standard fontset automatically according to the value
1161 of @code{standard-fontset-spec}. This fontset's name is
1162
1163 @example
1164 -*-fixed-medium-r-normal-*-16-*-*-*-*-*-fontset-standard
1165 @end example
1166
1167 @noindent
1168 or just @samp{fontset-standard} for short.
1169
1170 Bold, italic, and bold-italic variants of the standard fontset are
1171 created automatically. Their names have @samp{bold} instead of
1172 @samp{medium}, or @samp{i} instead of @samp{r}, or both.
1173
1174 @cindex startup fontset
1175 If you specify a default @acronym{ASCII} font with the @samp{Font} resource or
1176 the @samp{-fn} argument, Emacs generates a fontset from it
1177 automatically. This is the @dfn{startup fontset} and its name is
1178 @code{fontset-startup}. It does this by replacing the @var{foundry},
1179 @var{family}, @var{add_style}, and @var{average_width} fields of the
1180 font name with @samp{*}, replacing @var{charset_registry} field with
1181 @samp{fontset}, and replacing @var{charset_encoding} field with
1182 @samp{startup}, then using the resulting string to specify a fontset.
1183
1184 For instance, if you start Emacs this way,
1185
1186 @example
1187 emacs -fn "*courier-medium-r-normal--14-140-*-iso8859-1"
1188 @end example
1189
1190 @noindent
1191 Emacs generates the following fontset and uses it for the initial X
1192 window frame:
1193
1194 @example
1195 -*-*-medium-r-normal-*-14-140-*-*-*-*-fontset-startup
1196 @end example
1197
1198 With the X resource @samp{Emacs.Font}, you can specify a fontset name
1199 just like an actual font name. But be careful not to specify a fontset
1200 name in a wildcard resource like @samp{Emacs*Font}---that wildcard
1201 specification matches various other resources, such as for menus, and
1202 menus cannot handle fontsets.
1203
1204 You can specify additional fontsets using X resources named
1205 @samp{Fontset-@var{n}}, where @var{n} is an integer starting from 0.
1206 The resource value should have this form:
1207
1208 @smallexample
1209 @var{fontpattern}, @r{[}@var{charsetname}:@var{fontname}@r{]@dots{}}
1210 @end smallexample
1211
1212 @noindent
1213 @var{fontpattern} should have the form of a standard X font name, except
1214 for the last two fields. They should have the form
1215 @samp{fontset-@var{alias}}.
1216
1217 The fontset has two names, one long and one short. The long name is
1218 @var{fontpattern}. The short name is @samp{fontset-@var{alias}}. You
1219 can refer to the fontset by either name.
1220
1221 The construct @samp{@var{charset}:@var{font}} specifies which font to
1222 use (in this fontset) for one particular character set. Here,
1223 @var{charset} is the name of a character set, and @var{font} is the
1224 font to use for that character set. You can use this construct any
1225 number of times in defining one fontset.
1226
1227 For the other character sets, Emacs chooses a font based on
1228 @var{fontpattern}. It replaces @samp{fontset-@var{alias}} with values
1229 that describe the character set. For the @acronym{ASCII} character font,
1230 @samp{fontset-@var{alias}} is replaced with @samp{ISO8859-1}.
1231
1232 In addition, when several consecutive fields are wildcards, Emacs
1233 collapses them into a single wildcard. This is to prevent use of
1234 auto-scaled fonts. Fonts made by scaling larger fonts are not usable
1235 for editing, and scaling a smaller font is not useful because it is
1236 better to use the smaller font in its own size, which is what Emacs
1237 does.
1238
1239 Thus if @var{fontpattern} is this,
1240
1241 @example
1242 -*-fixed-medium-r-normal-*-24-*-*-*-*-*-fontset-24
1243 @end example
1244
1245 @noindent
1246 the font specification for @acronym{ASCII} characters would be this:
1247
1248 @example
1249 -*-fixed-medium-r-normal-*-24-*-ISO8859-1
1250 @end example
1251
1252 @noindent
1253 and the font specification for Chinese GB2312 characters would be this:
1254
1255 @example
1256 -*-fixed-medium-r-normal-*-24-*-gb2312*-*
1257 @end example
1258
1259 You may not have any Chinese font matching the above font
1260 specification. Most X distributions include only Chinese fonts that
1261 have @samp{song ti} or @samp{fangsong ti} in @var{family} field. In
1262 such a case, @samp{Fontset-@var{n}} can be specified as below:
1263
1264 @smallexample
1265 Emacs.Fontset-0: -*-fixed-medium-r-normal-*-24-*-*-*-*-*-fontset-24,\
1266 chinese-gb2312:-*-*-medium-r-normal-*-24-*-gb2312*-*
1267 @end smallexample
1268
1269 @noindent
1270 Then, the font specifications for all but Chinese GB2312 characters have
1271 @samp{fixed} in the @var{family} field, and the font specification for
1272 Chinese GB2312 characters has a wild card @samp{*} in the @var{family}
1273 field.
1274
1275 @findex create-fontset-from-fontset-spec
1276 The function that processes the fontset resource value to create the
1277 fontset is called @code{create-fontset-from-fontset-spec}. You can also
1278 call this function explicitly to create a fontset.
1279
1280 @xref{Font X}, for more information about font naming in X.
1281
1282 @node Undisplayable Characters
1283 @section Undisplayable Characters
1284
1285 There may be a some non-@acronym{ASCII} characters that your terminal cannot
1286 display. Most non-windowing terminals support just a single character
1287 set (use the variable @code{default-terminal-coding-system}
1288 (@pxref{Specify Coding}) to tell Emacs which one); characters which
1289 can't be encoded in that coding system are displayed as @samp{?} by
1290 default.
1291
1292 Windowing terminals can display a broader range of characters, but
1293 you may not have fonts installed for all of them; characters that have
1294 no font appear as a hollow box.
1295
1296 If you use Latin-1 characters but your terminal can't display
1297 Latin-1, you can arrange to display mnemonic @acronym{ASCII} sequences
1298 instead, e.g.@: @samp{"o} for o-umlaut. Load the library
1299 @file{iso-ascii} to do this.
1300
1301 @vindex latin1-display
1302 If your terminal can display Latin-1, you can display characters
1303 from other European character sets using a mixture of equivalent
1304 Latin-1 characters and @acronym{ASCII} mnemonics. Customize the variable
1305 @code{latin1-display} to enable this. The mnemonic @acronym{ASCII}
1306 sequences mostly correspond to those of the prefix input methods.
1307
1308 @node Single-Byte Character Support
1309 @section Single-byte Character Set Support
1310
1311 @cindex European character sets
1312 @cindex accented characters
1313 @cindex ISO Latin character sets
1314 @cindex Unibyte operation
1315 The ISO 8859 Latin-@var{n} character sets define character codes in
1316 the range 0240 to 0377 octal (160 to 255 decimal) to handle the
1317 accented letters and punctuation needed by various European languages
1318 (and some non-European ones). If you disable multibyte characters,
1319 Emacs can still handle @emph{one} of these character codes at a time.
1320 To specify @emph{which} of these codes to use, invoke @kbd{M-x
1321 set-language-environment} and specify a suitable language environment
1322 such as @samp{Latin-@var{n}}.
1323
1324 For more information about unibyte operation, see @ref{Enabling
1325 Multibyte}. Note particularly that you probably want to ensure that
1326 your initialization files are read as unibyte if they contain non-@acronym{ASCII}
1327 characters.
1328
1329 @vindex unibyte-display-via-language-environment
1330 Emacs can also display those characters, provided the terminal or font
1331 in use supports them. This works automatically. Alternatively, if you
1332 are using a window system, Emacs can also display single-byte characters
1333 through fontsets, in effect by displaying the equivalent multibyte
1334 characters according to the current language environment. To request
1335 this, set the variable @code{unibyte-display-via-language-environment}
1336 to a non-@code{nil} value.
1337
1338 @cindex @code{iso-ascii} library
1339 If your terminal does not support display of the Latin-1 character
1340 set, Emacs can display these characters as @acronym{ASCII} sequences which at
1341 least give you a clear idea of what the characters are. To do this,
1342 load the library @code{iso-ascii}. Similar libraries for other
1343 Latin-@var{n} character sets could be implemented, but we don't have
1344 them yet.
1345
1346 @findex standard-display-8bit
1347 @cindex 8-bit display
1348 Normally non-ISO-8859 characters (decimal codes between 128 and 159
1349 inclusive) are displayed as octal escapes. You can change this for
1350 non-standard ``extended'' versions of ISO-8859 character sets by using the
1351 function @code{standard-display-8bit} in the @code{disp-table} library.
1352
1353 There are two ways to input single-byte non-@acronym{ASCII}
1354 characters:
1355
1356 @itemize @bullet
1357 @cindex 8-bit input
1358 @item
1359 You can use an input method for the selected language environment.
1360 @xref{Input Methods}. When you use an input method in a unibyte buffer,
1361 the non-@acronym{ASCII} character you specify with it is converted to unibyte.
1362
1363 @item
1364 If your keyboard can generate character codes 128 (decimal) and up,
1365 representing non-@acronym{ASCII} characters, you can type those character codes
1366 directly.
1367
1368 On a window system, you should not need to do anything special to use
1369 these keys; they should simply work. On a text-only terminal, you
1370 should use the command @code{M-x set-keyboard-coding-system} or the
1371 variable @code{keyboard-coding-system} to specify which coding system
1372 your keyboard uses (@pxref{Specify Coding}). Enabling this feature
1373 will probably require you to use @kbd{ESC} to type Meta characters;
1374 however, on a console terminal or in @code{xterm}, you can arrange for
1375 Meta to be converted to @kbd{ESC} and still be able type 8-bit
1376 characters present directly on the keyboard or using @kbd{Compose} or
1377 @kbd{AltGr} keys. @xref{User Input}.
1378
1379 @kindex C-x 8
1380 @cindex @code{iso-transl} library
1381 @cindex compose character
1382 @cindex dead character
1383 @item
1384 For Latin-1 only, you can use the key @kbd{C-x 8} as a ``compose
1385 character'' prefix for entry of non-@acronym{ASCII} Latin-1 printing
1386 characters. @kbd{C-x 8} is good for insertion (in the minibuffer as
1387 well as other buffers), for searching, and in any other context where
1388 a key sequence is allowed.
1389
1390 @kbd{C-x 8} works by loading the @code{iso-transl} library. Once that
1391 library is loaded, the @key{ALT} modifier key, if the keyboard has
1392 one, serves the same purpose as @kbd{C-x 8}: use @key{ALT} together
1393 with an accent character to modify the following letter. In addition,
1394 if the keyboard has keys for the Latin-1 ``dead accent characters,''
1395 they too are defined to compose with the following character, once
1396 @code{iso-transl} is loaded.
1397
1398 Use @kbd{C-x 8 C-h} to list all the available @kbd{C-x 8} translations.
1399 @end itemize
1400
1401 @node Charsets
1402 @section Charsets
1403 @cindex charsets
1404
1405 Emacs groups all supported characters into disjoint @dfn{charsets}.
1406 Each character code belongs to one and only one charset. For
1407 historical reasons, Emacs typically divides an 8-bit character code
1408 for an extended version of @acronym{ASCII} into two charsets: @acronym{ASCII}, which
1409 covers the codes 0 through 127, plus another charset which covers the
1410 ``right-hand part'' (the codes 128 and up). For instance, the
1411 characters of Latin-1 include the Emacs charset @code{ascii} plus the
1412 Emacs charset @code{latin-iso8859-1}.
1413
1414 Emacs characters belonging to different charsets may look the same,
1415 but they are still different characters. For example, the letter
1416 @samp{o} with acute accent in charset @code{latin-iso8859-1}, used for
1417 Latin-1, is different from the letter @samp{o} with acute accent in
1418 charset @code{latin-iso8859-2}, used for Latin-2.
1419
1420 @findex list-charset-chars
1421 @cindex characters in a certain charset
1422 @findex describe-character-set
1423 There are two commands for obtaining information about Emacs
1424 charsets. The command @kbd{M-x list-charset-chars} prompts for a name
1425 of a character set, and displays all the characters in that character
1426 set. The command @kbd{M-x describe-character-set} prompts for a
1427 charset name and displays information about that charset, including
1428 its internal representation within Emacs.
1429
1430 To find out which charset a character in the buffer belongs to,
1431 put point before it and type @kbd{C-u C-x =}.
1432
1433 @ignore
1434 arch-tag: 310ba60d-31ef-4ce7-91f1-f282dd57b6b3
1435 @end ignore