]> code.delx.au - gnu-emacs/blob - man/mule.texi
Preliminary Forth support.
[gnu-emacs] / man / mule.texi
1 @c This is part of the Emacs manual.
2 @c Copyright (C) 1997, 1999, 2000, 2001, 2002, 2003, 2004,
3 @c 2005 Free Software Foundation, Inc.
4 @c See file emacs.texi for copying conditions.
5 @node International, Major Modes, Frames, Top
6 @chapter International Character Set Support
7 @cindex MULE
8 @cindex international scripts
9 @cindex multibyte characters
10 @cindex encoding of characters
11
12 @cindex Celtic
13 @cindex Chinese
14 @cindex Cyrillic
15 @cindex Czech
16 @cindex Devanagari
17 @cindex Hindi
18 @cindex Marathi
19 @cindex Ethiopic
20 @cindex German
21 @cindex Greek
22 @cindex Hebrew
23 @cindex IPA
24 @cindex Japanese
25 @cindex Korean
26 @cindex Lao
27 @cindex Latin
28 @cindex Polish
29 @cindex Romanian
30 @cindex Slovak
31 @cindex Slovenian
32 @cindex Thai
33 @cindex Tibetan
34 @cindex Turkish
35 @cindex Vietnamese
36 @cindex Dutch
37 @cindex Spanish
38 Emacs supports a wide variety of international character sets,
39 including European and Vietnamese variants of the Latin alphabet, as
40 well as Cyrillic, Devanagari (for Hindi and Marathi), Ethiopic, Greek,
41 Han (for Chinese and Japanese), Hangul (for Korean), Hebrew, IPA,
42 Kannada, Lao, Malayalam, Tamil, Thai, Tibetan, and Vietnamese scripts.
43 These features have been merged from the modified version of Emacs
44 known as MULE (for ``MULti-lingual Enhancement to GNU Emacs'')
45
46 Emacs also supports various encodings of these characters used by
47 other internationalized software, such as word processors and mailers.
48
49 Emacs allows editing text with international characters by supporting
50 all the related activities:
51
52 @itemize @bullet
53 @item
54 You can visit files with non-@acronym{ASCII} characters, save non-@acronym{ASCII} text, and
55 pass non-@acronym{ASCII} text between Emacs and programs it invokes (such as
56 compilers, spell-checkers, and mailers). Setting your language
57 environment (@pxref{Language Environments}) takes care of setting up the
58 coding systems and other options for a specific language or culture.
59 Alternatively, you can specify how Emacs should encode or decode text
60 for each command; see @ref{Specify Coding}.
61
62 @item
63 You can display non-@acronym{ASCII} characters encoded by the various scripts.
64 This works by using appropriate fonts on X and similar graphics
65 displays (@pxref{Defining Fontsets}), and by sending special codes to
66 text-only displays (@pxref{Specify Coding}). If some characters are
67 displayed incorrectly, refer to @ref{Undisplayable Characters}, which
68 describes possible problems and explains how to solve them.
69
70 @item
71 You can insert non-@acronym{ASCII} characters or search for them. To do that,
72 you can specify an input method (@pxref{Select Input Method}) suitable
73 for your language, or use the default input method set up when you set
74 your language environment. If
75 your keyboard can produce non-@acronym{ASCII} characters, you can select an
76 appropriate keyboard coding system (@pxref{Specify Coding}), and Emacs
77 will accept those characters. Latin-1 characters can also be input by
78 using the @kbd{C-x 8} prefix, see @ref{Single-Byte Character Support,
79 C-x 8}. On X Window systems, your locale should be set to an
80 appropriate value to make sure Emacs interprets keyboard input
81 correctly; see @ref{Language Environments, locales}.
82 @end itemize
83
84 The rest of this chapter describes these issues in detail.
85
86 @menu
87 * International Chars:: Basic concepts of multibyte characters.
88 * Enabling Multibyte:: Controlling whether to use multibyte characters.
89 * Language Environments:: Setting things up for the language you use.
90 * Input Methods:: Entering text characters not on your keyboard.
91 * Select Input Method:: Specifying your choice of input methods.
92 * Multibyte Conversion:: How single-byte characters convert to multibyte.
93 * Coding Systems:: Character set conversion when you read and
94 write files, and so on.
95 * Recognize Coding:: How Emacs figures out which conversion to use.
96 * Specify Coding:: Various ways to choose which conversion to use.
97 * Fontsets:: Fontsets are collections of fonts
98 that cover the whole spectrum of characters.
99 * Defining Fontsets:: Defining a new fontset.
100 * Undisplayable Characters:: When characters don't display.
101 * Single-Byte Character Support:: You can pick one European character set
102 to use without multibyte characters.
103 * Charsets:: How Emacs groups its internal character codes.
104 @end menu
105
106 @node International Chars
107 @section Introduction to International Character Sets
108
109 The users of international character sets and scripts have established
110 many more-or-less standard coding systems for storing files. Emacs
111 internally uses a single multibyte character encoding, so that it can
112 intermix characters from all these scripts in a single buffer or string.
113 This encoding represents each non-@acronym{ASCII} character as a sequence of bytes
114 in the range 0200 through 0377. Emacs translates between the multibyte
115 character encoding and various other coding systems when reading and
116 writing files, when exchanging data with subprocesses, and (in some
117 cases) in the @kbd{C-q} command (@pxref{Multibyte Conversion}).
118
119 @kindex C-h h
120 @findex view-hello-file
121 @cindex undisplayable characters
122 @cindex @samp{?} in display
123 The command @kbd{C-h h} (@code{view-hello-file}) displays the file
124 @file{etc/HELLO}, which shows how to say ``hello'' in many languages.
125 This illustrates various scripts. If some characters can't be
126 displayed on your terminal, they appear as @samp{?} or as hollow boxes
127 (@pxref{Undisplayable Characters}).
128
129 Keyboards, even in the countries where these character sets are used,
130 generally don't have keys for all the characters in them. So Emacs
131 supports various @dfn{input methods}, typically one for each script or
132 language, to make it convenient to type them.
133
134 @kindex C-x RET
135 The prefix key @kbd{C-x @key{RET}} is used for commands that pertain
136 to multibyte characters, coding systems, and input methods.
137
138 @node Enabling Multibyte
139 @section Enabling Multibyte Characters
140
141 @cindex turn multibyte support on or off
142 You can enable or disable multibyte character support, either for
143 Emacs as a whole, or for a single buffer. When multibyte characters are
144 disabled in a buffer, then each byte in that buffer represents a
145 character, even codes 0200 through 0377. The old features for
146 supporting the European character sets, ISO Latin-1 and ISO Latin-2,
147 work as they did in Emacs 19 and also work for the other ISO 8859
148 character sets.
149
150 However, there is no need to turn off multibyte character support to
151 use ISO Latin; the Emacs multibyte character set includes all the
152 characters in these character sets, and Emacs can translate
153 automatically to and from the ISO codes.
154
155 By default, Emacs starts in multibyte mode, because that allows you to
156 use all the supported languages and scripts without limitations.
157
158 To edit a particular file in unibyte representation, visit it using
159 @code{find-file-literally}. @xref{Visiting}. To convert a buffer in
160 multibyte representation into a single-byte representation of the same
161 characters, the easiest way is to save the contents in a file, kill the
162 buffer, and find the file again with @code{find-file-literally}. You
163 can also use @kbd{C-x @key{RET} c}
164 (@code{universal-coding-system-argument}) and specify @samp{raw-text} as
165 the coding system with which to find or save a file. @xref{Specify
166 Coding}. Finding a file as @samp{raw-text} doesn't disable format
167 conversion, uncompression and auto mode selection as
168 @code{find-file-literally} does.
169
170 @vindex enable-multibyte-characters
171 @vindex default-enable-multibyte-characters
172 To turn off multibyte character support by default, start Emacs with
173 the @samp{--unibyte} option (@pxref{Initial Options}), or set the
174 environment variable @env{EMACS_UNIBYTE}. You can also customize
175 @code{enable-multibyte-characters} or, equivalently, directly set the
176 variable @code{default-enable-multibyte-characters} to @code{nil} in
177 your init file to have basically the same effect as @samp{--unibyte}.
178
179 @findex toggle-enable-multibyte-characters
180 To convert a unibyte session to a multibyte session, set
181 @code{default-enable-multibyte-characters} to @code{t}. Buffers which
182 were created in the unibyte session before you turn on multibyte support
183 will stay unibyte. You can turn on multibyte support in a specific
184 buffer by invoking the command @code{toggle-enable-multibyte-characters}
185 in that buffer.
186
187 @cindex Lisp files, and multibyte operation
188 @cindex multibyte operation, and Lisp files
189 @cindex unibyte operation, and Lisp files
190 @cindex init file, and non-@acronym{ASCII} characters
191 @cindex environment variables, and non-@acronym{ASCII} characters
192 With @samp{--unibyte}, multibyte strings are not created during
193 initialization from the values of environment variables,
194 @file{/etc/passwd} entries etc.@: that contain non-@acronym{ASCII} 8-bit
195 characters.
196
197 Emacs normally loads Lisp files as multibyte, regardless of whether
198 you used @samp{--unibyte}. This includes the Emacs initialization file,
199 @file{.emacs}, and the initialization files of Emacs packages such as
200 Gnus. However, you can specify unibyte loading for a particular Lisp
201 file, by putting @w{@samp{-*-unibyte: t;-*-}} in a comment on the first
202 line (@pxref{File Variables}). Then that file is always loaded as
203 unibyte text, even if you did not start Emacs with @samp{--unibyte}.
204 The motivation for these conventions is that it is more reliable to
205 always load any particular Lisp file in the same way. However, you can
206 load a Lisp file as unibyte, on any one occasion, by typing @kbd{C-x
207 @key{RET} c raw-text @key{RET}} immediately before loading it.
208
209 The mode line indicates whether multibyte character support is enabled
210 in the current buffer. If it is, there are two or more characters (most
211 often two dashes) before the colon near the beginning of the mode line.
212 When multibyte characters are not enabled, just one dash precedes the
213 colon.
214
215 @node Language Environments
216 @section Language Environments
217 @cindex language environments
218
219 All supported character sets are supported in Emacs buffers whenever
220 multibyte characters are enabled; there is no need to select a
221 particular language in order to display its characters in an Emacs
222 buffer. However, it is important to select a @dfn{language environment}
223 in order to set various defaults. The language environment really
224 represents a choice of preferred script (more or less) rather than a
225 choice of language.
226
227 The language environment controls which coding systems to recognize
228 when reading text (@pxref{Recognize Coding}). This applies to files,
229 incoming mail, netnews, and any other text you read into Emacs. It may
230 also specify the default coding system to use when you create a file.
231 Each language environment also specifies a default input method.
232
233 @findex set-language-environment
234 @vindex current-language-environment
235 To select a language environment, you can customize the variable
236 @code{current-language-environment} or use the command @kbd{M-x
237 set-language-environment}. It makes no difference which buffer is
238 current when you use this command, because the effects apply globally to
239 the Emacs session. The supported language environments include:
240
241 @cindex Euro sign
242 @cindex UTF-8
243 @quotation
244 Belarusian, Brazilian Portuguese, Bulgarian, Chinese-BIG5,
245 Chinese-CNS, Chinese-EUC-TW, Chinese-GB, Croatian, Cyrillic-ALT,
246 Cyrillic-ISO, Cyrillic-KOI8, Czech, Devanagari, Dutch, English,
247 Ethiopic, French, Georgian, German, Greek, Hebrew, IPA, Italian,
248 Japanese, Kannada, Korean, Lao, Latin-1, Latin-2, Latin-3,
249 Latin-4, Latin-5, Latin-6, Latin-7, Latin-8 (Celtic),
250 Latin-9 (updated Latin-1 with the Euro sign), Latvian,
251 Lithuanian, Malayalam, Polish, Romanian, Russian, Slovak,
252 Slovenian, Spanish, Swedish, Tajik, Tamil, Thai, Tibetan,
253 Turkish, UTF-8 (for a setup which prefers Unicode characters and
254 files encoded in UTF-8), Ukrainian, Vietnamese, Welsh, and
255 Windows-1255 (for a setup which prefers Cyrillic characters and
256 files encoded in Windows-1255).
257 @end quotation
258
259 @cindex fonts for various scripts
260 @cindex Intlfonts package, installation
261 To display the script(s) used by your language environment on a
262 graphical display, you need to have a suitable font. If some of the
263 characters appear as empty boxes, you should install the GNU Intlfonts
264 package, which includes fonts for most supported scripts.@footnote{If
265 you run Emacs on X, you need to inform the X server about the location
266 of the newly installed fonts with the following commands:
267
268 @example
269 xset fp+ /usr/local/share/emacs/fonts
270 xset fp rehash
271 @end example
272 }
273 @xref{Fontsets}, for more details about setting up your fonts.
274
275 @findex set-locale-environment
276 @vindex locale-language-names
277 @vindex locale-charset-language-names
278 @cindex locales
279 Some operating systems let you specify the character-set locale you
280 are using by setting the locale environment variables @env{LC_ALL},
281 @env{LC_CTYPE}, or @env{LANG}.@footnote{If more than one of these is
282 set, the first one that is nonempty specifies your locale for this
283 purpose.} During startup, Emacs looks up your character-set locale's
284 name in the system locale alias table, matches its canonical name
285 against entries in the value of the variables
286 @code{locale-charset-language-names} and @code{locale-language-names},
287 and selects the corresponding language environment if a match is found.
288 (The former variable overrides the latter.) It also adjusts the display
289 table and terminal coding system, the locale coding system, the
290 preferred coding system as needed for the locale, and---last but not
291 least---the way Emacs decodes non-@acronym{ASCII} characters sent by your keyboard.
292
293 If you modify the @env{LC_ALL}, @env{LC_CTYPE}, or @env{LANG}
294 environment variables while running Emacs, you may want to invoke the
295 @code{set-locale-environment} function afterwards to readjust the
296 language environment from the new locale.
297
298 @vindex locale-preferred-coding-systems
299 The @code{set-locale-environment} function normally uses the preferred
300 coding system established by the language environment to decode system
301 messages. But if your locale matches an entry in the variable
302 @code{locale-preferred-coding-systems}, Emacs uses the corresponding
303 coding system instead. For example, if the locale @samp{ja_JP.PCK}
304 matches @code{japanese-shift-jis} in
305 @code{locale-preferred-coding-systems}, Emacs uses that encoding even
306 though it might normally use @code{japanese-iso-8bit}.
307
308 You can override the language environment chosen at startup with
309 explicit use of the command @code{set-language-environment}, or with
310 customization of @code{current-language-environment} in your init
311 file.
312
313 @kindex C-h L
314 @findex describe-language-environment
315 To display information about the effects of a certain language
316 environment @var{lang-env}, use the command @kbd{C-h L @var{lang-env}
317 @key{RET}} (@code{describe-language-environment}). This tells you which
318 languages this language environment is useful for, and lists the
319 character sets, coding systems, and input methods that go with it. It
320 also shows some sample text to illustrate scripts used in this language
321 environment. By default, this command describes the chosen language
322 environment.
323
324 @vindex set-language-environment-hook
325 You can customize any language environment with the normal hook
326 @code{set-language-environment-hook}. The command
327 @code{set-language-environment} runs that hook after setting up the new
328 language environment. The hook functions can test for a specific
329 language environment by checking the variable
330 @code{current-language-environment}. This hook is where you should
331 put non-default settings for specific language environment, such as
332 coding systems for keyboard input and terminal output, the default
333 input method, etc.
334
335 @vindex exit-language-environment-hook
336 Before it starts to set up the new language environment,
337 @code{set-language-environment} first runs the hook
338 @code{exit-language-environment-hook}. This hook is useful for undoing
339 customizations that were made with @code{set-language-environment-hook}.
340 For instance, if you set up a special key binding in a specific language
341 environment using @code{set-language-environment-hook}, you should set
342 up @code{exit-language-environment-hook} to restore the normal binding
343 for that key.
344
345 @node Input Methods
346 @section Input Methods
347
348 @cindex input methods
349 An @dfn{input method} is a kind of character conversion designed
350 specifically for interactive input. In Emacs, typically each language
351 has its own input method; sometimes several languages which use the same
352 characters can share one input method. A few languages support several
353 input methods.
354
355 The simplest kind of input method works by mapping @acronym{ASCII} letters
356 into another alphabet; this allows you to use one other alphabet
357 instead of @acronym{ASCII}. The Greek and Russian input methods
358 work this way.
359
360 A more powerful technique is composition: converting sequences of
361 characters into one letter. Many European input methods use composition
362 to produce a single non-@acronym{ASCII} letter from a sequence that consists of a
363 letter followed by accent characters (or vice versa). For example, some
364 methods convert the sequence @kbd{a'} into a single accented letter.
365 These input methods have no special commands of their own; all they do
366 is compose sequences of printing characters.
367
368 The input methods for syllabic scripts typically use mapping followed
369 by composition. The input methods for Thai and Korean work this way.
370 First, letters are mapped into symbols for particular sounds or tone
371 marks; then, sequences of these which make up a whole syllable are
372 mapped into one syllable sign.
373
374 Chinese and Japanese require more complex methods. In Chinese input
375 methods, first you enter the phonetic spelling of a Chinese word (in
376 input method @code{chinese-py}, among others), or a sequence of
377 portions of the character (input methods @code{chinese-4corner} and
378 @code{chinese-sw}, and others). One input sequence typically
379 corresponds to many possible Chinese characters. You select the one
380 you mean using keys such as @kbd{C-f}, @kbd{C-b}, @kbd{C-n},
381 @kbd{C-p}, and digits, which have special meanings in this situation.
382
383 The possible characters are conceptually arranged in several rows,
384 with each row holding up to 10 alternatives. Normally, Emacs displays
385 just one row at a time, in the echo area; @code{(@var{i}/@var{j})}
386 appears at the beginning, to indicate that this is the @var{i}th row
387 out of a total of @var{j} rows. Type @kbd{C-n} or @kbd{C-p} to
388 display the next row or the previous row.
389
390 Type @kbd{C-f} and @kbd{C-b} to move forward and backward among
391 the alternatives in the current row. As you do this, Emacs highlights
392 the current alternative with a special color; type @code{C-@key{SPC}}
393 to select the current alternative and use it as input. The
394 alternatives in the row are also numbered; the number appears before
395 the alternative. Typing a digit @var{n} selects the @var{n}th
396 alternative of the current row and uses it as input.
397
398 @key{TAB} in these Chinese input methods displays a buffer showing
399 all the possible characters at once; then clicking @kbd{Mouse-2} on
400 one of them selects that alternative. The keys @kbd{C-f}, @kbd{C-b},
401 @kbd{C-n}, @kbd{C-p}, and digits continue to work as usual, but they
402 do the highlighting in the buffer showing the possible characters,
403 rather than in the echo area.
404
405 In Japanese input methods, first you input a whole word using
406 phonetic spelling; then, after the word is in the buffer, Emacs
407 converts it into one or more characters using a large dictionary. One
408 phonetic spelling corresponds to a number of different Japanese words;
409 to select one of them, use @kbd{C-n} and @kbd{C-p} to cycle through
410 the alternatives.
411
412 Sometimes it is useful to cut off input method processing so that the
413 characters you have just entered will not combine with subsequent
414 characters. For example, in input method @code{latin-1-postfix}, the
415 sequence @kbd{e '} combines to form an @samp{e} with an accent. What if
416 you want to enter them as separate characters?
417
418 One way is to type the accent twice; this is a special feature for
419 entering the separate letter and accent. For example, @kbd{e ' '} gives
420 you the two characters @samp{e'}. Another way is to type another letter
421 after the @kbd{e}---something that won't combine with that---and
422 immediately delete it. For example, you could type @kbd{e e @key{DEL}
423 '} to get separate @samp{e} and @samp{'}.
424
425 Another method, more general but not quite as easy to type, is to use
426 @kbd{C-\ C-\} between two characters to stop them from combining. This
427 is the command @kbd{C-\} (@code{toggle-input-method}) used twice.
428 @ifinfo
429 @xref{Select Input Method}.
430 @end ifinfo
431
432 @cindex incremental search, input method interference
433 @kbd{C-\ C-\} is especially useful inside an incremental search,
434 because it stops waiting for more characters to combine, and starts
435 searching for what you have already entered.
436
437 To find out how to input the character after point using the current
438 input method, type @kbd{C-u C-x =}. @xref{Position Info}.
439
440 @vindex input-method-verbose-flag
441 @vindex input-method-highlight-flag
442 The variables @code{input-method-highlight-flag} and
443 @code{input-method-verbose-flag} control how input methods explain
444 what is happening. If @code{input-method-highlight-flag} is
445 non-@code{nil}, the partial sequence is highlighted in the buffer (for
446 most input methods---some disable this feature). If
447 @code{input-method-verbose-flag} is non-@code{nil}, the list of
448 possible characters to type next is displayed in the echo area (but
449 not when you are in the minibuffer).
450
451 @node Select Input Method
452 @section Selecting an Input Method
453
454 @table @kbd
455 @item C-\
456 Enable or disable use of the selected input method.
457
458 @item C-x @key{RET} C-\ @var{method} @key{RET}
459 Select a new input method for the current buffer.
460
461 @item C-h I @var{method} @key{RET}
462 @itemx C-h C-\ @var{method} @key{RET}
463 @findex describe-input-method
464 @kindex C-h I
465 @kindex C-h C-\
466 Describe the input method @var{method} (@code{describe-input-method}).
467 By default, it describes the current input method (if any). This
468 description should give you the full details of how to use any
469 particular input method.
470
471 @item M-x list-input-methods
472 Display a list of all the supported input methods.
473 @end table
474
475 @findex set-input-method
476 @vindex current-input-method
477 @kindex C-x RET C-\
478 To choose an input method for the current buffer, use @kbd{C-x
479 @key{RET} C-\} (@code{set-input-method}). This command reads the
480 input method name from the minibuffer; the name normally starts with the
481 language environment that it is meant to be used with. The variable
482 @code{current-input-method} records which input method is selected.
483
484 @findex toggle-input-method
485 @kindex C-\
486 Input methods use various sequences of @acronym{ASCII} characters to stand for
487 non-@acronym{ASCII} characters. Sometimes it is useful to turn off the input
488 method temporarily. To do this, type @kbd{C-\}
489 (@code{toggle-input-method}). To reenable the input method, type
490 @kbd{C-\} again.
491
492 If you type @kbd{C-\} and you have not yet selected an input method,
493 it prompts for you to specify one. This has the same effect as using
494 @kbd{C-x @key{RET} C-\} to specify an input method.
495
496 When invoked with a numeric argument, as in @kbd{C-u C-\},
497 @code{toggle-input-method} always prompts you for an input method,
498 suggesting the most recently selected one as the default.
499
500 @vindex default-input-method
501 Selecting a language environment specifies a default input method for
502 use in various buffers. When you have a default input method, you can
503 select it in the current buffer by typing @kbd{C-\}. The variable
504 @code{default-input-method} specifies the default input method
505 (@code{nil} means there is none).
506
507 In some language environments, which support several different input
508 methods, you might want to use an input method different from the
509 default chosen by @code{set-language-environment}. You can instruct
510 Emacs to select a different default input method for a certain
511 language environment, if you wish, by using
512 @code{set-language-environment-hook} (@pxref{Language Environments,
513 set-language-environment-hook}). For example:
514
515 @lisp
516 (defun my-chinese-setup ()
517 "Set up my private Chinese environment."
518 (if (equal current-language-environment "Chinese-GB")
519 (setq default-input-method "chinese-tonepy")))
520 (add-hook 'set-language-environment-hook 'my-chinese-setup)
521 @end lisp
522
523 @noindent
524 This sets the default input method to be @code{chinese-tonepy}
525 whenever you choose a Chinese-GB language environment.
526
527 @findex quail-set-keyboard-layout
528 Some input methods for alphabetic scripts work by (in effect)
529 remapping the keyboard to emulate various keyboard layouts commonly used
530 for those scripts. How to do this remapping properly depends on your
531 actual keyboard layout. To specify which layout your keyboard has, use
532 the command @kbd{M-x quail-set-keyboard-layout}.
533
534 @findex quail-show-key
535 You can use the command @kbd{M-x quail-show-key} to show what key (or
536 key sequence) to type in order to input the character following point,
537 using the selected keyboard layout. The command @kbd{C-u C-x =} also
538 shows that information in addition to the other information about the
539 character.
540
541 @findex list-input-methods
542 To display a list of all the supported input methods, type @kbd{M-x
543 list-input-methods}. The list gives information about each input
544 method, including the string that stands for it in the mode line.
545
546 @node Multibyte Conversion
547 @section Unibyte and Multibyte Non-@acronym{ASCII} characters
548
549 When multibyte characters are enabled, character codes 0240 (octal)
550 through 0377 (octal) are not really legitimate in the buffer. The valid
551 non-@acronym{ASCII} printing characters have codes that start from 0400.
552
553 If you type a self-inserting character in the range 0240 through
554 0377, or if you use @kbd{C-q} to insert one, Emacs assumes you
555 intended to use one of the ISO Latin-@var{n} character sets, and
556 converts it to the Emacs code representing that Latin-@var{n}
557 character. You select @emph{which} ISO Latin character set to use
558 through your choice of language environment
559 @iftex
560 (see above).
561 @end iftex
562 @ifinfo
563 (@pxref{Language Environments}).
564 @end ifinfo
565 If you do not specify a choice, the default is Latin-1.
566
567 If you insert a character in the range 0200 through 0237, which
568 forms the @code{eight-bit-control} character set, it is inserted
569 literally. You should normally avoid doing this since buffers
570 containing such characters have to be written out in either the
571 @code{emacs-mule} or @code{raw-text} coding system, which is usually
572 not what you want.
573
574 @node Coding Systems
575 @section Coding Systems
576 @cindex coding systems
577
578 Users of various languages have established many more-or-less standard
579 coding systems for representing them. Emacs does not use these coding
580 systems internally; instead, it converts from various coding systems to
581 its own system when reading data, and converts the internal coding
582 system to other coding systems when writing data. Conversion is
583 possible in reading or writing files, in sending or receiving from the
584 terminal, and in exchanging data with subprocesses.
585
586 Emacs assigns a name to each coding system. Most coding systems are
587 used for one language, and the name of the coding system starts with the
588 language name. Some coding systems are used for several languages;
589 their names usually start with @samp{iso}. There are also special
590 coding systems @code{no-conversion}, @code{raw-text} and
591 @code{emacs-mule} which do not convert printing characters at all.
592
593 @cindex international files from DOS/Windows systems
594 A special class of coding systems, collectively known as
595 @dfn{codepages}, is designed to support text encoded by MS-Windows and
596 MS-DOS software. The names of these coding systems are
597 @code{cp@var{nnnn}}, where @var{nnnn} is a 3- or 4-digit number of the
598 codepage. You can use these encodings just like any other coding
599 system; for example, to visit a file encoded in codepage 850, type
600 @kbd{C-x @key{RET} c cp850 @key{RET} C-x C-f @var{filename}
601 @key{RET}}@footnote{
602 In the MS-DOS port of Emacs, you need to create a @code{cp@var{nnn}}
603 coding system with @kbd{M-x codepage-setup}, before you can use it.
604 @xref{MS-DOS and MULE}.}.
605
606 In addition to converting various representations of non-@acronym{ASCII}
607 characters, a coding system can perform end-of-line conversion. Emacs
608 handles three different conventions for how to separate lines in a file:
609 newline, carriage-return linefeed, and just carriage-return.
610
611 @table @kbd
612 @item C-h C @var{coding} @key{RET}
613 Describe coding system @var{coding}.
614
615 @item C-h C @key{RET}
616 Describe the coding systems currently in use.
617
618 @item M-x list-coding-systems
619 Display a list of all the supported coding systems.
620 @end table
621
622 @kindex C-h C
623 @findex describe-coding-system
624 The command @kbd{C-h C} (@code{describe-coding-system}) displays
625 information about particular coding systems. You can specify a coding
626 system name as the argument; alternatively, with an empty argument, it
627 describes the coding systems currently selected for various purposes,
628 both in the current buffer and as the defaults, and the priority list
629 for recognizing coding systems (@pxref{Recognize Coding}).
630
631 @findex list-coding-systems
632 To display a list of all the supported coding systems, type @kbd{M-x
633 list-coding-systems}. The list gives information about each coding
634 system, including the letter that stands for it in the mode line
635 (@pxref{Mode Line}).
636
637 @cindex end-of-line conversion
638 @cindex MS-DOS end-of-line conversion
639 @cindex Macintosh end-of-line conversion
640 Each of the coding systems that appear in this list---except for
641 @code{no-conversion}, which means no conversion of any kind---specifies
642 how and whether to convert printing characters, but leaves the choice of
643 end-of-line conversion to be decided based on the contents of each file.
644 For example, if the file appears to use the sequence carriage-return
645 linefeed to separate lines, DOS end-of-line conversion will be used.
646
647 Each of the listed coding systems has three variants which specify
648 exactly what to do for end-of-line conversion:
649
650 @table @code
651 @item @dots{}-unix
652 Don't do any end-of-line conversion; assume the file uses
653 newline to separate lines. (This is the convention normally used
654 on Unix and GNU systems.)
655
656 @item @dots{}-dos
657 Assume the file uses carriage-return linefeed to separate lines, and do
658 the appropriate conversion. (This is the convention normally used on
659 Microsoft systems.@footnote{It is also specified for MIME @samp{text/*}
660 bodies and in other network transport contexts. It is different
661 from the SGML reference syntax record-start/record-end format which
662 Emacs doesn't support directly.})
663
664 @item @dots{}-mac
665 Assume the file uses carriage-return to separate lines, and do the
666 appropriate conversion. (This is the convention normally used on the
667 Macintosh system.)
668 @end table
669
670 These variant coding systems are omitted from the
671 @code{list-coding-systems} display for brevity, since they are entirely
672 predictable. For example, the coding system @code{iso-latin-1} has
673 variants @code{iso-latin-1-unix}, @code{iso-latin-1-dos} and
674 @code{iso-latin-1-mac}.
675
676 The coding system @code{raw-text} is good for a file which is mainly
677 @acronym{ASCII} text, but may contain byte values above 127 which are not meant to
678 encode non-@acronym{ASCII} characters. With @code{raw-text}, Emacs copies those
679 byte values unchanged, and sets @code{enable-multibyte-characters} to
680 @code{nil} in the current buffer so that they will be interpreted
681 properly. @code{raw-text} handles end-of-line conversion in the usual
682 way, based on the data encountered, and has the usual three variants to
683 specify the kind of end-of-line conversion to use.
684
685 In contrast, the coding system @code{no-conversion} specifies no
686 character code conversion at all---none for non-@acronym{ASCII} byte values and
687 none for end of line. This is useful for reading or writing binary
688 files, tar files, and other files that must be examined verbatim. It,
689 too, sets @code{enable-multibyte-characters} to @code{nil}.
690
691 The easiest way to edit a file with no conversion of any kind is with
692 the @kbd{M-x find-file-literally} command. This uses
693 @code{no-conversion}, and also suppresses other Emacs features that
694 might convert the file contents before you see them. @xref{Visiting}.
695
696 The coding system @code{emacs-mule} means that the file contains
697 non-@acronym{ASCII} characters stored with the internal Emacs encoding. It
698 handles end-of-line conversion based on the data encountered, and has
699 the usual three variants to specify the kind of end-of-line conversion.
700
701 @node Recognize Coding
702 @section Recognizing Coding Systems
703
704 Emacs tries to recognize which coding system to use for a given text
705 as an integral part of reading that text. (This applies to files
706 being read, output from subprocesses, text from X selections, etc.)
707 Emacs can select the right coding system automatically most of the
708 time---once you have specified your preferences.
709
710 Some coding systems can be recognized or distinguished by which byte
711 sequences appear in the data. However, there are coding systems that
712 cannot be distinguished, not even potentially. For example, there is no
713 way to distinguish between Latin-1 and Latin-2; they use the same byte
714 values with different meanings.
715
716 Emacs handles this situation by means of a priority list of coding
717 systems. Whenever Emacs reads a file, if you do not specify the coding
718 system to use, Emacs checks the data against each coding system,
719 starting with the first in priority and working down the list, until it
720 finds a coding system that fits the data. Then it converts the file
721 contents assuming that they are represented in this coding system.
722
723 The priority list of coding systems depends on the selected language
724 environment (@pxref{Language Environments}). For example, if you use
725 French, you probably want Emacs to prefer Latin-1 to Latin-2; if you use
726 Czech, you probably want Latin-2 to be preferred. This is one of the
727 reasons to specify a language environment.
728
729 @findex prefer-coding-system
730 However, you can alter the coding system priority list in detail
731 with the command @kbd{M-x prefer-coding-system}. This command reads
732 the name of a coding system from the minibuffer, and adds it to the
733 front of the priority list, so that it is preferred to all others. If
734 you use this command several times, each use adds one element to the
735 front of the priority list.
736
737 If you use a coding system that specifies the end-of-line conversion
738 type, such as @code{iso-8859-1-dos}, what this means is that Emacs
739 should attempt to recognize @code{iso-8859-1} with priority, and should
740 use DOS end-of-line conversion when it does recognize @code{iso-8859-1}.
741
742 @vindex file-coding-system-alist
743 Sometimes a file name indicates which coding system to use for the
744 file. The variable @code{file-coding-system-alist} specifies this
745 correspondence. There is a special function
746 @code{modify-coding-system-alist} for adding elements to this list. For
747 example, to read and write all @samp{.txt} files using the coding system
748 @code{china-iso-8bit}, you can execute this Lisp expression:
749
750 @smallexample
751 (modify-coding-system-alist 'file "\\.txt\\'" 'chinese-iso-8bit)
752 @end smallexample
753
754 @noindent
755 The first argument should be @code{file}, the second argument should be
756 a regular expression that determines which files this applies to, and
757 the third argument says which coding system to use for these files.
758
759 @vindex inhibit-eol-conversion
760 @cindex DOS-style end-of-line display
761 Emacs recognizes which kind of end-of-line conversion to use based on
762 the contents of the file: if it sees only carriage-returns, or only
763 carriage-return linefeed sequences, then it chooses the end-of-line
764 conversion accordingly. You can inhibit the automatic use of
765 end-of-line conversion by setting the variable @code{inhibit-eol-conversion}
766 to non-@code{nil}. If you do that, DOS-style files will be displayed
767 with the @samp{^M} characters visible in the buffer; some people
768 prefer this to the more subtle @samp{(DOS)} end-of-line type
769 indication near the left edge of the mode line (@pxref{Mode Line,
770 eol-mnemonic}).
771
772 @vindex inhibit-iso-escape-detection
773 @cindex escape sequences in files
774 By default, the automatic detection of coding system is sensitive to
775 escape sequences. If Emacs sees a sequence of characters that begin
776 with an escape character, and the sequence is valid as an ISO-2022
777 code, that tells Emacs to use one of the ISO-2022 encodings to decode
778 the file.
779
780 However, there may be cases that you want to read escape sequences
781 in a file as is. In such a case, you can set the variable
782 @code{inhibit-iso-escape-detection} to non-@code{nil}. Then the code
783 detection ignores any escape sequences, and never uses an ISO-2022
784 encoding. The result is that all escape sequences become visible in
785 the buffer.
786
787 The default value of @code{inhibit-iso-escape-detection} is
788 @code{nil}. We recommend that you not change it permanently, only for
789 one specific operation. That's because many Emacs Lisp source files
790 in the Emacs distribution contain non-@acronym{ASCII} characters encoded in the
791 coding system @code{iso-2022-7bit}, and they won't be
792 decoded correctly when you visit those files if you suppress the
793 escape sequence detection.
794
795 @vindex coding
796 You can specify the coding system for a particular file using the
797 @w{@samp{-*-@dots{}-*-}} construct at the beginning of a file, or a
798 local variables list at the end (@pxref{File Variables}). You do this
799 by defining a value for the ``variable'' named @code{coding}. Emacs
800 does not really have a variable @code{coding}; instead of setting a
801 variable, this uses the specified coding system for the file. For
802 example, @samp{-*-mode: C; coding: latin-1;-*-} specifies use of the
803 Latin-1 coding system, as well as C mode. When you specify the coding
804 explicitly in the file, that overrides
805 @code{file-coding-system-alist}.
806
807 @vindex auto-coding-alist
808 @vindex auto-coding-regexp-alist
809 @vindex auto-coding-functions
810 The variables @code{auto-coding-alist},
811 @code{auto-coding-regexp-alist} and @code{auto-coding-functions} are
812 the strongest way to specify the coding system for certain patterns of
813 file names, or for files containing certain patterns; these variables
814 even override @samp{-*-coding:-*-} tags in the file itself. Emacs
815 uses @code{auto-coding-alist} for tar and archive files, to prevent it
816 from being confused by a @samp{-*-coding:-*-} tag in a member of the
817 archive and thinking it applies to the archive file as a whole.
818 Likewise, Emacs uses @code{auto-coding-regexp-alist} to ensure that
819 RMAIL files, whose names in general don't match any particular
820 pattern, are decoded correctly. One of the builtin
821 @code{auto-coding-functions} detects the encoding for XML files.
822
823 If Emacs recognizes the encoding of a file incorrectly, you can
824 reread the file using the correct coding system by typing @kbd{C-x
825 @key{RET} r @var{coding-system}
826 @key{RET}}. To see what coding system Emacs actually used to decode
827 the file, look at the coding system mnemonic letter near the left edge
828 of the mode line (@pxref{Mode Line}), or type @kbd{C-h C @key{RET}}.
829
830 @findex unify-8859-on-decoding-mode
831 The command @code{unify-8859-on-decoding-mode} enables a mode that
832 ``unifies'' the Latin alphabets when decoding text. This works by
833 converting all non-@acronym{ASCII} Latin-@var{n} characters to either Latin-1 or
834 Unicode characters. This way it is easier to use various
835 Latin-@var{n} alphabets together. In a future Emacs version we hope
836 to move towards full Unicode support and complete unification of
837 character sets.
838
839 @vindex buffer-file-coding-system
840 Once Emacs has chosen a coding system for a buffer, it stores that
841 coding system in @code{buffer-file-coding-system} and uses that coding
842 system, by default, for operations that write from this buffer into a
843 file. This includes the commands @code{save-buffer} and
844 @code{write-region}. If you want to write files from this buffer using
845 a different coding system, you can specify a different coding system for
846 the buffer using @code{set-buffer-file-coding-system} (@pxref{Specify
847 Coding}).
848
849 You can insert any possible character into any Emacs buffer, but
850 most coding systems can only handle some of the possible characters.
851 This means that it is possible for you to insert characters that
852 cannot be encoded with the coding system that will be used to save the
853 buffer. For example, you could start with an @acronym{ASCII} file and insert a
854 few Latin-1 characters into it, or you could edit a text file in
855 Polish encoded in @code{iso-8859-2} and add some Russian words to it.
856 When you save the buffer, Emacs cannot use the current value of
857 @code{buffer-file-coding-system}, because the characters you added
858 cannot be encoded by that coding system.
859
860 When that happens, Emacs tries the most-preferred coding system (set
861 by @kbd{M-x prefer-coding-system} or @kbd{M-x
862 set-language-environment}), and if that coding system can safely
863 encode all of the characters in the buffer, Emacs uses it, and stores
864 its value in @code{buffer-file-coding-system}. Otherwise, Emacs
865 displays a list of coding systems suitable for encoding the buffer's
866 contents, and asks you to choose one of those coding systems.
867
868 If you insert the unsuitable characters in a mail message, Emacs
869 behaves a bit differently. It additionally checks whether the
870 most-preferred coding system is recommended for use in MIME messages;
871 if not, Emacs tells you that the most-preferred coding system is
872 not recommended and prompts you for another coding system. This is so
873 you won't inadvertently send a message encoded in a way that your
874 recipient's mail software will have difficulty decoding. (If you do
875 want to use the most-preferred coding system, you can still type its
876 name in response to the question.)
877
878 @vindex sendmail-coding-system
879 When you send a message with Mail mode (@pxref{Sending Mail}), Emacs has
880 four different ways to determine the coding system to use for encoding
881 the message text. It tries the buffer's own value of
882 @code{buffer-file-coding-system}, if that is non-@code{nil}. Otherwise,
883 it uses the value of @code{sendmail-coding-system}, if that is
884 non-@code{nil}. The third way is to use the default coding system for
885 new files, which is controlled by your choice of language environment,
886 if that is non-@code{nil}. If all of these three values are @code{nil},
887 Emacs encodes outgoing mail using the Latin-1 coding system.
888
889 @vindex rmail-decode-mime-charset
890 When you get new mail in Rmail, each message is translated
891 automatically from the coding system it is written in, as if it were a
892 separate file. This uses the priority list of coding systems that you
893 have specified. If a MIME message specifies a character set, Rmail
894 obeys that specification, unless @code{rmail-decode-mime-charset} is
895 @code{nil}.
896
897 @vindex rmail-file-coding-system
898 For reading and saving Rmail files themselves, Emacs uses the coding
899 system specified by the variable @code{rmail-file-coding-system}. The
900 default value is @code{nil}, which means that Rmail files are not
901 translated (they are read and written in the Emacs internal character
902 code).
903
904 @node Specify Coding
905 @section Specifying a Coding System
906
907 In cases where Emacs does not automatically choose the right coding
908 system, you can use these commands to specify one:
909
910 @table @kbd
911 @item C-x @key{RET} f @var{coding} @key{RET}
912 Use coding system @var{coding} for saving or revisiting the visited
913 file in the current buffer.
914
915 @item C-x @key{RET} c @var{coding} @key{RET}
916 Specify coding system @var{coding} for the immediately following
917 command.
918
919 @item C-x @key{RET} r @var{coding} @key{RET}
920 Revisit the current file using the coding system @var{coding}.
921
922 @item C-x @key{RET} k @var{coding} @key{RET}
923 Use coding system @var{coding} for keyboard input.
924
925 @item C-x @key{RET} t @var{coding} @key{RET}
926 Use coding system @var{coding} for terminal output.
927
928 @item C-x @key{RET} p @var{input-coding} @key{RET} @var{output-coding} @key{RET}
929 Use coding systems @var{input-coding} and @var{output-coding} for
930 subprocess input and output in the current buffer.
931
932 @item C-x @key{RET} x @var{coding} @key{RET}
933 Use coding system @var{coding} for transferring selections to and from
934 other programs through the window system.
935
936 @item C-x @key{RET} F @var{coding} @key{RET}
937 Use coding system @var{coding} for encoding and decoding file
938 @emph{names}. This affects the use of non-ASCII characters in file
939 names. It has no effect on reading and writing the @emph{contents} of
940 files.
941
942 @item C-x @key{RET} X @var{coding} @key{RET}
943 Use coding system @var{coding} for transferring @emph{one}
944 selection---the next one---to or from the window system.
945
946 @item M-x recode-region
947 Convert the region from a previous coding system to a new one.
948 @end table
949
950 @kindex C-x RET f
951 @findex set-buffer-file-coding-system
952 The command @kbd{C-x @key{RET} f}
953 (@code{set-buffer-file-coding-system}) sets the file coding system for
954 the current buffer---in other words, it says which coding system to
955 use when saving or reverting the visited file. You specify which
956 coding system using the minibuffer. If you specify a coding system
957 that cannot handle all of the characters in the buffer, Emacs warns
958 you about the troublesome characters when you actually save the
959 buffer.
960
961 @kindex C-x RET c
962 @findex universal-coding-system-argument
963 Another way to specify the coding system for a file is when you visit
964 the file. First use the command @kbd{C-x @key{RET} c}
965 (@code{universal-coding-system-argument}); this command uses the
966 minibuffer to read a coding system name. After you exit the minibuffer,
967 the specified coding system is used for @emph{the immediately following
968 command}.
969
970 So if the immediately following command is @kbd{C-x C-f}, for example,
971 it reads the file using that coding system (and records the coding
972 system for when you later save the file). Or if the immediately following
973 command is @kbd{C-x C-w}, it writes the file using that coding system.
974 When you specify the coding system for saving in this way, instead
975 of with @kbd{C-x @key{RET} f}, there is no warning if the buffer
976 contains characters that the coding system cannot handle.
977
978 Other file commands affected by a specified coding system include
979 @kbd{C-x C-i} and @kbd{C-x C-v}, as well as the other-window variants
980 of @kbd{C-x C-f}. @kbd{C-x @key{RET} c} also affects commands that
981 start subprocesses, including @kbd{M-x shell} (@pxref{Shell}).
982
983 If the immediately following command does not use the coding system,
984 then @kbd{C-x @key{RET} c} ultimately has no effect.
985
986 An easy way to visit a file with no conversion is with the @kbd{M-x
987 find-file-literally} command. @xref{Visiting}.
988
989 @vindex default-buffer-file-coding-system
990 The variable @code{default-buffer-file-coding-system} specifies the
991 choice of coding system to use when you create a new file. It applies
992 when you find a new file, and when you create a buffer and then save it
993 in a file. Selecting a language environment typically sets this
994 variable to a good choice of default coding system for that language
995 environment.
996
997 @kindex C-x RET r
998 @findex revert-buffer-with-coding-system
999 If you visit a file with a wrong coding system, you can correct this
1000 with @kbd{C-x @key{RET} r} (@code{revert-buffer-with-coding-system}).
1001 This visits the current file again, using a coding system you specify.
1002
1003 @kindex C-x RET t
1004 @findex set-terminal-coding-system
1005 The command @kbd{C-x @key{RET} t} (@code{set-terminal-coding-system})
1006 specifies the coding system for terminal output. If you specify a
1007 character code for terminal output, all characters output to the
1008 terminal are translated into that coding system.
1009
1010 This feature is useful for certain character-only terminals built to
1011 support specific languages or character sets---for example, European
1012 terminals that support one of the ISO Latin character sets. You need to
1013 specify the terminal coding system when using multibyte text, so that
1014 Emacs knows which characters the terminal can actually handle.
1015
1016 By default, output to the terminal is not translated at all, unless
1017 Emacs can deduce the proper coding system from your terminal type or
1018 your locale specification (@pxref{Language Environments}).
1019
1020 @kindex C-x RET k
1021 @findex set-keyboard-coding-system
1022 @vindex keyboard-coding-system
1023 The command @kbd{C-x @key{RET} k} (@code{set-keyboard-coding-system})
1024 or the variable @code{keyboard-coding-system} specifies the coding
1025 system for keyboard input. Character-code translation of keyboard
1026 input is useful for terminals with keys that send non-@acronym{ASCII}
1027 graphic characters---for example, some terminals designed for ISO
1028 Latin-1 or subsets of it.
1029
1030 By default, keyboard input is translated based on your system locale
1031 setting. If your terminal does not really support the encoding
1032 implied by your locale (for example, if you find it inserts a
1033 non-@acronym{ASCII} character if you type @kbd{M-i}), you will need to set
1034 @code{keyboard-coding-system} to @code{nil} to turn off encoding.
1035 You can do this by putting
1036
1037 @lisp
1038 (set-keyboard-coding-system nil)
1039 @end lisp
1040
1041 @noindent
1042 in your @file{~/.emacs} file.
1043
1044 There is a similarity between using a coding system translation for
1045 keyboard input, and using an input method: both define sequences of
1046 keyboard input that translate into single characters. However, input
1047 methods are designed to be convenient for interactive use by humans, and
1048 the sequences that are translated are typically sequences of @acronym{ASCII}
1049 printing characters. Coding systems typically translate sequences of
1050 non-graphic characters.
1051
1052 @kindex C-x RET x
1053 @kindex C-x RET X
1054 @findex set-selection-coding-system
1055 @findex set-next-selection-coding-system
1056 The command @kbd{C-x @key{RET} x} (@code{set-selection-coding-system})
1057 specifies the coding system for sending selected text to the window
1058 system, and for receiving the text of selections made in other
1059 applications. This command applies to all subsequent selections, until
1060 you override it by using the command again. The command @kbd{C-x
1061 @key{RET} X} (@code{set-next-selection-coding-system}) specifies the
1062 coding system for the next selection made in Emacs or read by Emacs.
1063
1064 @kindex C-x RET p
1065 @findex set-buffer-process-coding-system
1066 The command @kbd{C-x @key{RET} p} (@code{set-buffer-process-coding-system})
1067 specifies the coding system for input and output to a subprocess. This
1068 command applies to the current buffer; normally, each subprocess has its
1069 own buffer, and thus you can use this command to specify translation to
1070 and from a particular subprocess by giving the command in the
1071 corresponding buffer.
1072
1073 The default for translation of process input and output depends on the
1074 current language environment.
1075
1076 @findex recode-region
1077 If a piece of text has already been inserted into a buffer using the
1078 wrong coding system, you can decode it again using @kbd{M-x
1079 recode-region}. This prompts you for the old coding system and the
1080 desired coding system, and acts on the text in the region.
1081
1082 @vindex file-name-coding-system
1083 @cindex file names with non-@acronym{ASCII} characters
1084 @findex set-file-name-coding-system
1085 @kindex C-x @key{RET} F
1086 The variable @code{file-name-coding-system} specifies a coding
1087 system to use for encoding file names. If you set the variable to a
1088 coding system name (as a Lisp symbol or a string), Emacs encodes file
1089 names using that coding system for all file operations. This makes it
1090 possible to use non-@acronym{ASCII} characters in file names---or, at
1091 least, those non-@acronym{ASCII} characters which the specified coding
1092 system can encode. Use @kbd{C-x @key{RET} F}
1093 (@code{set-file-name-coding-system}) to specify this interactively.
1094
1095 If @code{file-name-coding-system} is @code{nil}, Emacs uses a default
1096 coding system determined by the selected language environment. In the
1097 default language environment, any non-@acronym{ASCII} characters in file names are
1098 not encoded specially; they appear in the file system using the internal
1099 Emacs representation.
1100
1101 @strong{Warning:} if you change @code{file-name-coding-system} (or the
1102 language environment) in the middle of an Emacs session, problems can
1103 result if you have already visited files whose names were encoded using
1104 the earlier coding system and cannot be encoded (or are encoded
1105 differently) under the new coding system. If you try to save one of
1106 these buffers under the visited file name, saving may use the wrong file
1107 name, or it may get an error. If such a problem happens, use @kbd{C-x
1108 C-w} to specify a new file name for that buffer.
1109
1110 @findex recode-file-name
1111 If a mistake occurs when encoding a file name, use the command
1112 @kbd{M-x recode-file-name} to change the file name's coding
1113 system. This prompts for an existing file name, its old coding
1114 system, and the coding system to which you wish to convert.
1115
1116 @vindex locale-coding-system
1117 @cindex decoding non-@acronym{ASCII} keyboard input on X
1118 The variable @code{locale-coding-system} specifies a coding system
1119 to use when encoding and decoding system strings such as system error
1120 messages and @code{format-time-string} formats and time stamps. That
1121 coding system is also used for decoding non-@acronym{ASCII} keyboard input on X
1122 Window systems. You should choose a coding system that is compatible
1123 with the underlying system's text representation, which is normally
1124 specified by one of the environment variables @env{LC_ALL},
1125 @env{LC_CTYPE}, and @env{LANG}. (The first one, in the order
1126 specified above, whose value is nonempty is the one that determines
1127 the text representation.)
1128
1129 @node Fontsets
1130 @section Fontsets
1131 @cindex fontsets
1132
1133 A font for X typically defines shapes for a single alphabet or script.
1134 Therefore, displaying the entire range of scripts that Emacs supports
1135 requires a collection of many fonts. In Emacs, such a collection is
1136 called a @dfn{fontset}. A fontset is defined by a list of fonts, each
1137 assigned to handle a range of character codes.
1138
1139 Each fontset has a name, like a font. The available X fonts are
1140 defined by the X server; fontsets, however, are defined within Emacs
1141 itself. Once you have defined a fontset, you can use it within Emacs by
1142 specifying its name, anywhere that you could use a single font. Of
1143 course, Emacs fontsets can use only the fonts that the X server
1144 supports; if certain characters appear on the screen as hollow boxes,
1145 this means that the fontset in use for them has no font for those
1146 characters.@footnote{The Emacs installation instructions have information on
1147 additional font support.}
1148
1149 Emacs creates two fontsets automatically: the @dfn{standard fontset}
1150 and the @dfn{startup fontset}. The standard fontset is most likely to
1151 have fonts for a wide variety of non-@acronym{ASCII} characters; however, this is
1152 not the default for Emacs to use. (By default, Emacs tries to find a
1153 font that has bold and italic variants.) You can specify use of the
1154 standard fontset with the @samp{-fn} option, or with the @samp{Font} X
1155 resource (@pxref{Font X}). For example,
1156
1157 @example
1158 emacs -fn fontset-standard
1159 @end example
1160
1161 A fontset does not necessarily specify a font for every character
1162 code. If a fontset specifies no font for a certain character, or if it
1163 specifies a font that does not exist on your system, then it cannot
1164 display that character properly. It will display that character as an
1165 empty box instead.
1166
1167 @node Defining Fontsets
1168 @section Defining fontsets
1169
1170 @vindex standard-fontset-spec
1171 @cindex standard fontset
1172 Emacs creates a standard fontset automatically according to the value
1173 of @code{standard-fontset-spec}. This fontset's name is
1174
1175 @example
1176 -*-fixed-medium-r-normal-*-16-*-*-*-*-*-fontset-standard
1177 @end example
1178
1179 @noindent
1180 or just @samp{fontset-standard} for short.
1181
1182 Bold, italic, and bold-italic variants of the standard fontset are
1183 created automatically. Their names have @samp{bold} instead of
1184 @samp{medium}, or @samp{i} instead of @samp{r}, or both.
1185
1186 @cindex startup fontset
1187 If you specify a default @acronym{ASCII} font with the @samp{Font} resource or
1188 the @samp{-fn} argument, Emacs generates a fontset from it
1189 automatically. This is the @dfn{startup fontset} and its name is
1190 @code{fontset-startup}. It does this by replacing the @var{foundry},
1191 @var{family}, @var{add_style}, and @var{average_width} fields of the
1192 font name with @samp{*}, replacing @var{charset_registry} field with
1193 @samp{fontset}, and replacing @var{charset_encoding} field with
1194 @samp{startup}, then using the resulting string to specify a fontset.
1195
1196 For instance, if you start Emacs this way,
1197
1198 @example
1199 emacs -fn "*courier-medium-r-normal--14-140-*-iso8859-1"
1200 @end example
1201
1202 @noindent
1203 Emacs generates the following fontset and uses it for the initial X
1204 window frame:
1205
1206 @example
1207 -*-*-medium-r-normal-*-14-140-*-*-*-*-fontset-startup
1208 @end example
1209
1210 With the X resource @samp{Emacs.Font}, you can specify a fontset name
1211 just like an actual font name. But be careful not to specify a fontset
1212 name in a wildcard resource like @samp{Emacs*Font}---that wildcard
1213 specification matches various other resources, such as for menus, and
1214 menus cannot handle fontsets.
1215
1216 You can specify additional fontsets using X resources named
1217 @samp{Fontset-@var{n}}, where @var{n} is an integer starting from 0.
1218 The resource value should have this form:
1219
1220 @smallexample
1221 @var{fontpattern}, @r{[}@var{charsetname}:@var{fontname}@r{]@dots{}}
1222 @end smallexample
1223
1224 @noindent
1225 @var{fontpattern} should have the form of a standard X font name, except
1226 for the last two fields. They should have the form
1227 @samp{fontset-@var{alias}}.
1228
1229 The fontset has two names, one long and one short. The long name is
1230 @var{fontpattern}. The short name is @samp{fontset-@var{alias}}. You
1231 can refer to the fontset by either name.
1232
1233 The construct @samp{@var{charset}:@var{font}} specifies which font to
1234 use (in this fontset) for one particular character set. Here,
1235 @var{charset} is the name of a character set, and @var{font} is the
1236 font to use for that character set. You can use this construct any
1237 number of times in defining one fontset.
1238
1239 For the other character sets, Emacs chooses a font based on
1240 @var{fontpattern}. It replaces @samp{fontset-@var{alias}} with values
1241 that describe the character set. For the @acronym{ASCII} character font,
1242 @samp{fontset-@var{alias}} is replaced with @samp{ISO8859-1}.
1243
1244 In addition, when several consecutive fields are wildcards, Emacs
1245 collapses them into a single wildcard. This is to prevent use of
1246 auto-scaled fonts. Fonts made by scaling larger fonts are not usable
1247 for editing, and scaling a smaller font is not useful because it is
1248 better to use the smaller font in its own size, which is what Emacs
1249 does.
1250
1251 Thus if @var{fontpattern} is this,
1252
1253 @example
1254 -*-fixed-medium-r-normal-*-24-*-*-*-*-*-fontset-24
1255 @end example
1256
1257 @noindent
1258 the font specification for @acronym{ASCII} characters would be this:
1259
1260 @example
1261 -*-fixed-medium-r-normal-*-24-*-ISO8859-1
1262 @end example
1263
1264 @noindent
1265 and the font specification for Chinese GB2312 characters would be this:
1266
1267 @example
1268 -*-fixed-medium-r-normal-*-24-*-gb2312*-*
1269 @end example
1270
1271 You may not have any Chinese font matching the above font
1272 specification. Most X distributions include only Chinese fonts that
1273 have @samp{song ti} or @samp{fangsong ti} in @var{family} field. In
1274 such a case, @samp{Fontset-@var{n}} can be specified as below:
1275
1276 @smallexample
1277 Emacs.Fontset-0: -*-fixed-medium-r-normal-*-24-*-*-*-*-*-fontset-24,\
1278 chinese-gb2312:-*-*-medium-r-normal-*-24-*-gb2312*-*
1279 @end smallexample
1280
1281 @noindent
1282 Then, the font specifications for all but Chinese GB2312 characters have
1283 @samp{fixed} in the @var{family} field, and the font specification for
1284 Chinese GB2312 characters has a wild card @samp{*} in the @var{family}
1285 field.
1286
1287 @findex create-fontset-from-fontset-spec
1288 The function that processes the fontset resource value to create the
1289 fontset is called @code{create-fontset-from-fontset-spec}. You can also
1290 call this function explicitly to create a fontset.
1291
1292 @xref{Font X}, for more information about font naming in X.
1293
1294 @node Undisplayable Characters
1295 @section Undisplayable Characters
1296
1297 There may be a some non-@acronym{ASCII} characters that your terminal cannot
1298 display. Most non-windowing terminals support just a single character
1299 set (use the variable @code{default-terminal-coding-system}
1300 (@pxref{Specify Coding}) to tell Emacs which one); characters which
1301 can't be encoded in that coding system are displayed as @samp{?} by
1302 default.
1303
1304 Windowing terminals can display a broader range of characters, but
1305 you may not have fonts installed for all of them; characters that have
1306 no font appear as a hollow box.
1307
1308 If you use Latin-1 characters but your terminal can't display
1309 Latin-1, you can arrange to display mnemonic @acronym{ASCII} sequences
1310 instead, e.g.@: @samp{"o} for o-umlaut. Load the library
1311 @file{iso-ascii} to do this.
1312
1313 @vindex latin1-display
1314 If your terminal can display Latin-1, you can display characters
1315 from other European character sets using a mixture of equivalent
1316 Latin-1 characters and @acronym{ASCII} mnemonics. Customize the variable
1317 @code{latin1-display} to enable this. The mnemonic @acronym{ASCII}
1318 sequences mostly correspond to those of the prefix input methods.
1319
1320 @node Single-Byte Character Support
1321 @section Single-byte Character Set Support
1322
1323 @cindex European character sets
1324 @cindex accented characters
1325 @cindex ISO Latin character sets
1326 @cindex Unibyte operation
1327 The ISO 8859 Latin-@var{n} character sets define character codes in
1328 the range 0240 to 0377 octal (160 to 255 decimal) to handle the
1329 accented letters and punctuation needed by various European languages
1330 (and some non-European ones). If you disable multibyte characters,
1331 Emacs can still handle @emph{one} of these character codes at a time.
1332 To specify @emph{which} of these codes to use, invoke @kbd{M-x
1333 set-language-environment} and specify a suitable language environment
1334 such as @samp{Latin-@var{n}}.
1335
1336 For more information about unibyte operation, see @ref{Enabling
1337 Multibyte}. Note particularly that you probably want to ensure that
1338 your initialization files are read as unibyte if they contain non-@acronym{ASCII}
1339 characters.
1340
1341 @vindex unibyte-display-via-language-environment
1342 Emacs can also display those characters, provided the terminal or font
1343 in use supports them. This works automatically. Alternatively, if you
1344 are using a window system, Emacs can also display single-byte characters
1345 through fontsets, in effect by displaying the equivalent multibyte
1346 characters according to the current language environment. To request
1347 this, set the variable @code{unibyte-display-via-language-environment}
1348 to a non-@code{nil} value.
1349
1350 @cindex @code{iso-ascii} library
1351 If your terminal does not support display of the Latin-1 character
1352 set, Emacs can display these characters as @acronym{ASCII} sequences which at
1353 least give you a clear idea of what the characters are. To do this,
1354 load the library @code{iso-ascii}. Similar libraries for other
1355 Latin-@var{n} character sets could be implemented, but we don't have
1356 them yet.
1357
1358 @findex standard-display-8bit
1359 @cindex 8-bit display
1360 Normally non-ISO-8859 characters (decimal codes between 128 and 159
1361 inclusive) are displayed as octal escapes. You can change this for
1362 non-standard ``extended'' versions of ISO-8859 character sets by using the
1363 function @code{standard-display-8bit} in the @code{disp-table} library.
1364
1365 There are two ways to input single-byte non-@acronym{ASCII}
1366 characters:
1367
1368 @itemize @bullet
1369 @cindex 8-bit input
1370 @item
1371 You can use an input method for the selected language environment.
1372 @xref{Input Methods}. When you use an input method in a unibyte buffer,
1373 the non-@acronym{ASCII} character you specify with it is converted to unibyte.
1374
1375 @item
1376 If your keyboard can generate character codes 128 (decimal) and up,
1377 representing non-@acronym{ASCII} characters, you can type those character codes
1378 directly.
1379
1380 On a window system, you should not need to do anything special to use
1381 these keys; they should simply work. On a text-only terminal, you
1382 should use the command @code{M-x set-keyboard-coding-system} or the
1383 variable @code{keyboard-coding-system} to specify which coding system
1384 your keyboard uses (@pxref{Specify Coding}). Enabling this feature
1385 will probably require you to use @kbd{ESC} to type Meta characters;
1386 however, on a console terminal or in @code{xterm}, you can arrange for
1387 Meta to be converted to @kbd{ESC} and still be able type 8-bit
1388 characters present directly on the keyboard or using @kbd{Compose} or
1389 @kbd{AltGr} keys. @xref{User Input}.
1390
1391 @kindex C-x 8
1392 @cindex @code{iso-transl} library
1393 @cindex compose character
1394 @cindex dead character
1395 @item
1396 For Latin-1 only, you can use the key @kbd{C-x 8} as a ``compose
1397 character'' prefix for entry of non-@acronym{ASCII} Latin-1 printing
1398 characters. @kbd{C-x 8} is good for insertion (in the minibuffer as
1399 well as other buffers), for searching, and in any other context where
1400 a key sequence is allowed.
1401
1402 @kbd{C-x 8} works by loading the @code{iso-transl} library. Once that
1403 library is loaded, the @key{ALT} modifier key, if the keyboard has
1404 one, serves the same purpose as @kbd{C-x 8}: use @key{ALT} together
1405 with an accent character to modify the following letter. In addition,
1406 if the keyboard has keys for the Latin-1 ``dead accent characters,''
1407 they too are defined to compose with the following character, once
1408 @code{iso-transl} is loaded.
1409
1410 Use @kbd{C-x 8 C-h} to list all the available @kbd{C-x 8} translations.
1411 @end itemize
1412
1413 @node Charsets
1414 @section Charsets
1415 @cindex charsets
1416
1417 Emacs groups all supported characters into disjoint @dfn{charsets}.
1418 Each character code belongs to one and only one charset. For
1419 historical reasons, Emacs typically divides an 8-bit character code
1420 for an extended version of @acronym{ASCII} into two charsets: @acronym{ASCII}, which
1421 covers the codes 0 through 127, plus another charset which covers the
1422 ``right-hand part'' (the codes 128 and up). For instance, the
1423 characters of Latin-1 include the Emacs charset @code{ascii} plus the
1424 Emacs charset @code{latin-iso8859-1}.
1425
1426 Emacs characters belonging to different charsets may look the same,
1427 but they are still different characters. For example, the letter
1428 @samp{o} with acute accent in charset @code{latin-iso8859-1}, used for
1429 Latin-1, is different from the letter @samp{o} with acute accent in
1430 charset @code{latin-iso8859-2}, used for Latin-2.
1431
1432 @findex list-charset-chars
1433 @cindex characters in a certain charset
1434 @findex describe-character-set
1435 There are two commands for obtaining information about Emacs
1436 charsets. The command @kbd{M-x list-charset-chars} prompts for a name
1437 of a character set, and displays all the characters in that character
1438 set. The command @kbd{M-x describe-character-set} prompts for a
1439 charset name and displays information about that charset, including
1440 its internal representation within Emacs.
1441
1442 To find out which charset a character in the buffer belongs to,
1443 put point before it and type @kbd{C-u C-x =}.
1444
1445 @ignore
1446 arch-tag: 310ba60d-31ef-4ce7-91f1-f282dd57b6b3
1447 @end ignore