(string_char_and_length): Fix previous change.

[gnu-emacs] / src / xdisp.c

/* Display generation from window structure and buffer text.
   Copyright (C) 1985, 86, 87, 88, 93, 94, 95, 97, 98, 99
   Free Software Foundation, Inc.

This file is part of GNU Emacs.

GNU Emacs is free software; you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2, or (at your option)
any later version.

GNU Emacs is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

You should have received a copy of the GNU General Public License
along with GNU Emacs; see the file COPYING.  If not, write to
the Free Software Foundation, Inc., 59 Temple Place - Suite 330,
Boston, MA 02111-1307, USA.  */

/* New redisplay written by Gerd Moellmann <gerd@gnu.org>.

   Redisplay.

   Emacs separates the task of updating the display from code
   modifying global state, e.g. buffer text.  This way functions
   operating on buffers don't also have to be concerned with updating
   the display.

   Updating the display is triggered by the Lisp interpreter when it
   decides it's time to do it.  This is done either automatically for
   you as part of the interpreter's command loop or as the result of
   calling Lisp functions like `sit-for'.  The C function `redisplay'
   in xdisp.c is the only entry into the inner redisplay code.  (Or,
   let's say almost---see the the description of direct update
   operations, below.).

   The following diagram shows how redisplay code is invoked.  As you
   can see, Lisp calls redisplay and vice versa.  Under window systems
   like X, some portions of the redisplay code are also called
   asynchronously during mouse movement or expose events.  It is very
   important that these code parts do NOT use the C library (malloc,
   free) because many C libraries under Unix are not reentrant.  They
   may also NOT call functions of the Lisp interpreter which could
   change the interpreter's state.  If you don't follow these rules,
   you will encounter bugs which are very hard to explain.

             (Direct functions, see below)
             direct_output_for_insert, 
             direct_forward_char (dispnew.c)
          +---------------------------------+
          |                                 |
          |                                 V
   +--------------+   redisplay()   +----------------+
   | Lisp machine |---------------->| Redisplay code |<--+
   +--------------+   (xdisp.c)     +----------------+   |
          ^                                  |           |
          +----------------------------------+           |
            Don't use this path when called              |
            asynchronously!                              |
                                                         |
                           expose_window (asynchronous)  |
                                                         |
                                   X expose events  -----+

   What does redisplay?  Obviously, it has to figure out somehow what
   has been changed since the last time the display has been updated,
   and to make these changes visible.  Preferably it would do that in
   a moderately intelligent way, i.e. fast.

   Changes in buffer text can be deduced from window and buffer
   structures, and from some global variables like `beg_unchanged' and
   `end_unchanged'.  The contents of the display are additionally
   recorded in a `glyph matrix', a two-dimensional matrix of glyph
   structures.  Each row in such a matrix corresponds to a line on the
   display, and each glyph in a row corresponds to a column displaying
   a character, an image, or what else.  This matrix is called the
   `current glyph matrix' or `current matrix' in redisplay
   terminology.

   For buffer parts that have been changed since the last update, a
   second glyph matrix is constructed, the so called `desired glyph
   matrix' or short `desired matrix'.  Current and desired matrix are
   then compared to find a cheap way to update the display, e.g. by
   reusing part of the display by scrolling lines.


   Direct operations.

   You will find a lot of of redisplay optimizations when you start
   looking at the innards of redisplay.  The overall goal of all these
   optimizations is to make redisplay fast because it is done
   frequently.

   Two optimizations are not found in xdisp.c.  These are the direct
   operations mentioned above.  As the name suggests they follow a
   different principle than the rest of redisplay.  Instead of
   building a desired matrix and then comparing it with the current
   display, they perform their actions directly on the display and on
   the current matrix.

   One direct operation updates the display after one character has
   been entered.  The other one moves the cursor by one position
   forward or backward.  You find these functions under the names
   `direct_output_for_insert' and `direct_output_forward_char' in
   dispnew.c.

   
   Desired matrices.

   Desired matrices are always built per Emacs window.  The function
   `display_line' is the central function to look at if you are
   interested.  It constructs one row in a desired matrix given an
   iterator structure containing both a buffer position and a
   description of the environment in which the text is to be
   displayed.  But this is too early, read on.

   Characters and pixmaps displayed for a range of buffer text depend
   on various settings of buffers and windows, on overlays and text
   properties, on display tables, on selective display.  The good news
   is that all this hairy stuff is hidden behind a small set of
   interface functions taking a iterator structure (struct it)
   argument.

   Iteration over things to be be displayed is then simple.  It is
   started by initializing an iterator with a call to init_iterator
   (or init_string_iterator for that matter).  Calls to
   get_next_display_element fill the iterator structure with relevant
   information about the next thing to display.  Calls to
   set_iterator_to_next move the iterator to the next thing.

   Besides this, an iterator also contains information about the
   display environment in which glyphs for display elements are to be
   produced.  It has fields for the width and height of the display,
   the information whether long lines are truncated or continued, a
   current X and Y position, and lots of other stuff you can better
   see in dispextern.h.

   Glyphs in a desired matrix are normally constructed in a loop
   calling get_next_display_element and then produce_glyphs.  The call
   to produce_glyphs will fill the iterator structure with pixel
   information about the element being displayed and at the same time
   produce glyphs for it.  If the display element fits on the line
   being displayed, set_iterator_to_next is called next, otherwise the
   glyphs produced are discarded.


   Frame matrices.

   That just couldn't be all, could it?  What about terminal types not
   supporting operations on sub-windows of the screen?  To update the
   display on such a terminal, window-based glyph matrices are not
   well suited.  To be able to reuse part of the display (scrolling
   lines up and down), we must instead have a view of the whole
   screen.  This is what `frame matrices' are for.  They are a trick.

   Frames on terminals like above have a glyph pool.  Windows on such
   a frame sub-allocate their glyph memory from their frame's glyph
   pool.  The frame itself is given its own glyph matrices.  By
   coincidence---or maybe something else---rows in window glyph
   matrices are slices of corresponding rows in frame matrices.  Thus
   writing to window matrices implicitly updates a frame matrix which
   provides us with the view of the whole screen that we originally
   wanted to have without having to move many bytes around.  To be
   honest, there is a little bit more done, but not much more.  If you
   plan to extend that code, take a look at dispnew.c.  The function
   build_frame_matrix is a good starting point.  */

#include <config.h>
#include <stdio.h>
#ifdef STDC_HEADERS
#include <stdlib.h>
#endif
#include "lisp.h"
#include "frame.h"
#include "window.h"
#include "termchar.h"
#include "dispextern.h"
#include "buffer.h"
#include "charset.h"
#include "indent.h"
#include "commands.h"
#include "macros.h"
#include "disptab.h"
#include "termhooks.h"
#include "intervals.h"
#include "keyboard.h"
#include "coding.h"
#include "process.h"
#include "region-cache.h"

#ifdef HAVE_X_WINDOWS
#include "xterm.h"
#endif

#define min(a, b) ((a) < (b) ? (a) : (b))
#define max(a, b) ((a) > (b) ? (a) : (b))

#define INFINITY 10000000

#if defined (USE_X_TOOLKIT) || defined (HAVE_NTGUI)
extern void set_frame_menubar ();
extern int pending_menu_activation;
#endif

extern int interrupt_input;
extern int command_loop_level;

extern int minibuffer_auto_raise;

extern Lisp_Object Qface;

extern Lisp_Object Voverriding_local_map;
extern Lisp_Object Voverriding_local_map_menu_flag;
extern Lisp_Object Qmenu_item;

Lisp_Object Qoverriding_local_map, Qoverriding_terminal_local_map;
Lisp_Object Qwindow_scroll_functions, Vwindow_scroll_functions;
Lisp_Object Qredisplay_end_trigger_functions;
Lisp_Object Qinhibit_point_motion_hooks;
Lisp_Object QCeval, QCwhen;
Lisp_Object Qfontified;

/* Functions called to fontify regions of text.  */

Lisp_Object Vfontification_functions;
Lisp_Object Qfontification_functions;

/* Non-zero means draw toolbar buttons raised when the mouse moves
   over them.  */

int auto_raise_toolbar_buttons_p;

/* Margin around toolbar buttons in pixels.  */

int toolbar_button_margin;

/* Thickness of shadow to draw around toolbar buttons.  */

int toolbar_button_relief;

/* Non-zero means automatically resize toolbars so that all toolbar
   items are visible, and no blank lines remain.  */

int auto_resize_toolbars_p;

/* Non-nil means don't actually do any redisplay.  */

Lisp_Object Vinhibit_redisplay, Qinhibit_redisplay;

/* Names of text properties relevant for redisplay.  */

Lisp_Object Qdisplay, Qrelative_width, Qwidth, Qalign_to;
extern Lisp_Object Qface, Qinvisible, Qimage;

/* Symbols used in text property values.  */

Lisp_Object Qspace, QCalign_to, QCrelative_width, QCrelative_height;
Lisp_Object Qleft_margin, Qright_margin, Qspace_width, Qheight, Qraise;

/* Name of the variable controlling the highlighting of trailing
   whitespace.  The implementation uses find_symbol_value to get its
   value.  */

Lisp_Object Qshow_trailing_whitespace;

/* Name of the face used to highlight trailing whitespace.  */

Lisp_Object Qtrailing_whitespace;

/* The symbol `image' which is the car of the lists used to represent
   images in Lisp.  */

Lisp_Object Qimage;

/* Non-zero means print newline to stdout before next mini-buffer
   message.  */

int noninteractive_need_newline;

/* Non-zero means print newline to message log before next message.  */

static int message_log_need_newline;

\f
/* The buffer position of the first character appearing entirely or
   partially on the line of the selected window which contains the
   cursor; <= 0 if not known.  Set by set_cursor_from_row, used for
   redisplay optimization in redisplay_internal.  */

static struct text_pos this_line_start_pos;

/* Number of characters past the end of the line above, including the
   terminating newline.  */

static struct text_pos this_line_end_pos;

/* The vertical positions and the height of this line.  */

static int this_line_vpos;
static int this_line_y;
static int this_line_pixel_height;

/* X position at which this display line starts.  Usually zero;
   negative if first character is partially visible.  */

static int this_line_start_x;

/* Buffer that this_line_.* variables are referring to.  */

static struct buffer *this_line_buffer;

/* Nonzero means truncate lines in all windows less wide than the
   frame.  */

int truncate_partial_width_windows;

/* A flag to control how to display unibyte 8-bit character.  */

int unibyte_display_via_language_environment;
 
/* Nonzero means we have more than one non-mini-buffer-only frame.
   Not guaranteed to be accurate except while parsing
   frame-title-format.  */

int multiple_frames;

Lisp_Object Vglobal_mode_string;

/* Marker for where to display an arrow on top of the buffer text.  */

Lisp_Object Voverlay_arrow_position;

/* String to display for the arrow.  Only used on terminal frames.  */

Lisp_Object Voverlay_arrow_string;

/* Values of those variables at last redisplay.  However, if
   Voverlay_arrow_position is a marker, last_arrow_position is its
   numerical position.  */

static Lisp_Object last_arrow_position, last_arrow_string;

/* Like mode-line-format, but for the title bar on a visible frame.  */

Lisp_Object Vframe_title_format;

/* Like mode-line-format, but for the title bar on an iconified frame.  */

Lisp_Object Vicon_title_format;

/* List of functions to call when a window's size changes.  These
   functions get one arg, a frame on which one or more windows' sizes
   have changed.  */

static Lisp_Object Vwindow_size_change_functions;

Lisp_Object Qmenu_bar_update_hook;

/* Nonzero if overlay arrow has been displayed once in this window.  */

static int overlay_arrow_seen;

/* Nonzero means highlight the region even in nonselected windows.  */

int highlight_nonselected_windows;

/* If cursor motion alone moves point off frame, try scrolling this
   many lines up or down if that will bring it back.  */

static int scroll_step;

/* Non-0 means scroll just far enough to bring point back on the
   screen, when appropriate.  */

static int scroll_conservatively;

/* Recenter the window whenever point gets within this many lines of
   the top or bottom of the window.  This value is translated into a
   pixel value by multiplying it with CANON_Y_UNIT, which means that
   there is really a fixed pixel height scroll margin.  */

int scroll_margin;

/* Number of characters of overlap to show, when scrolling a one-line
   window such as a minibuffer.  */

static int minibuffer_scroll_overlap;

/* Number of windows showing the buffer of the selected window (or
   another buffer with the same base buffer).  keyboard.c refers to
   this.  */

int buffer_shared;

/* Vector containing glyphs for an ellipsis `...'.  */

static Lisp_Object default_invis_vector[3];

/* Nonzero means display mode line highlighted.  */

int mode_line_inverse_video;

/* Prompt to display in front of the mini-buffer contents.  */

Lisp_Object minibuf_prompt;

/* Width of current mini-buffer prompt.  Only set after display_line
   of the line that contains the prompt.  */

int minibuf_prompt_width;
int minibuf_prompt_pixel_width;

/* Message to display instead of mini-buffer contents.  This is what
   the functions error and message make, and command echoing uses it
   as well.  It overrides the minibuf_prompt as well as the buffer.  */

char *echo_area_glyphs;

/* A Lisp string to display instead of mini-buffer contents, analogous
   to echo_area_glyphs.  If this is a string, display that string.
   Otherwise, if echo_area_glyphs is non-null, display that.  */

Lisp_Object echo_area_message;

/* This is the length of the message in echo_area_glyphs or
   echo_area_message.  */

int echo_area_glyphs_length;

/* Value of echo_area_glyphs when it was last acted on.  If this is
   nonzero, there is a message on the frame in the mini-buffer and it
   should be erased as soon as it is no longer requested to appear.  */

char *previous_echo_glyphs;
Lisp_Object previous_echo_area_message;
static int previous_echo_glyphs_length;

/* This is the window where the echo area message was displayed.  It
   is always a mini-buffer window, but it may not be the same window
   currently active as a mini-buffer.  */

Lisp_Object echo_area_window;

/* Nonzero means multibyte characters were enabled when the echo area
   message was specified.  */

int message_enable_multibyte;

/* True if we should redraw the mode lines on the next redisplay.  */

int update_mode_lines;

/* Smallest number of characters before the gap at any time since last
   redisplay that finished.  Valid for current buffer when
   try_window_id can be called.  */

int beg_unchanged;

/* Smallest number of characters after the gap at any time since last
   redisplay that finished.  Valid for current buffer when
   try_window_id can be called.  */

int end_unchanged;

/* MODIFF as of last redisplay that finished; if it matches MODIFF,
   and overlay_unchanged_modified matches OVERLAY_MODIFF, that means
   beg_unchanged and end_unchanged contain no useful information.  */

int unchanged_modified;

/* OVERLAY_MODIFF as of last redisplay that finished.  */

int overlay_unchanged_modified;

/* Nonzero if window sizes or contents have changed since last
   redisplay that finished */

int windows_or_buffers_changed;

/* Nonzero after display_mode_line if %l was used and it displayed a
   line number.  */

int line_number_displayed;

/* Maximum buffer size for which to display line numbers.  */

static int line_number_display_limit;

/* Number of lines to keep in the message log buffer.  t means
   infinite.  nil means don't log at all.  */

Lisp_Object Vmessage_log_max;

/* A scratch glyph row with contents used for generating truncation
   glyphs.  Also used in direct_output_for_insert.  */

#define MAX_SCRATCH_GLYPHS 100
struct glyph_row scratch_glyph_row;
static struct glyph scratch_glyphs[MAX_SCRATCH_GLYPHS];

/* Ascent and height of the last line processed by move_it_to.  */

static int last_max_ascent, last_height;

/* The maximum distance to look ahead for text properties.  Values
   that are too small let us call compute_char_face and similar 
   functions too often which is expensive.  Values that are too large
   let us call compute_char_face and alike too often because we
   might not be interested in text properties that far away.  */

#define TEXT_PROP_DISTANCE_LIMIT 100

/* Non-zero means print traces of redisplay if compiled with
   GLYPH_DEBUG != 0.  */

#if GLYPH_DEBUG
int trace_redisplay_p;
#endif

/* Value returned from text property handlers (see below).  */

enum prop_handled
{
  HANDLED_NORMALLY,
  HANDLED_RECOMPUTE_PROPS,
  HANDLED_OVERLAY_STRING_CONSUMED,
  HANDLED_RETURN
};

/* A description of text properties that redisplay is interested
   in.  */

struct props
{
  /* The name of the property.  */
  Lisp_Object *name;

  /* A unique index for the property.  */
  enum prop_idx idx;

  /* A handler function called to set up iterator IT from the property
     at IT's current position.  Value is used to steer handle_stop.  */
  enum prop_handled (*handler) P_ ((struct it *it));
};

static enum prop_handled handle_face_prop P_ ((struct it *));
static enum prop_handled handle_invisible_prop P_ ((struct it *));
static enum prop_handled handle_display_prop P_ ((struct it *));
static enum prop_handled handle_overlay_change P_ ((struct it *));
static enum prop_handled handle_fontified_prop P_ ((struct it *));

/* Properties handled by iterators.  */

static struct props it_props[] =
{
  {&Qfontified,         FONTIFIED_PROP_IDX,     handle_fontified_prop},
  /* Handle `face' before `display' because some sub-properties of
     `display' need to know the face.  */
  {&Qface,              FACE_PROP_IDX,          handle_face_prop},
  {&Qdisplay,           DISPLAY_PROP_IDX,       handle_display_prop},
  {&Qinvisible,         INVISIBLE_PROP_IDX,     handle_invisible_prop},
  {NULL,                0,                      NULL}
};

/* Value is the position described by X.  If X is a marker, value is
   the marker_position of X.  Otherwise, value is X.  */

#define COERCE_MARKER(X) (MARKERP ((X)) ? Fmarker_position (X) : (X))

/* Enumeration returned by some move_it_.* functions internally.  */

enum move_it_result
{
  /* Not used.  Undefined value.  */
  MOVE_UNDEFINED,

  /* Move ended at the requested buffer position or ZV.  */
  MOVE_POS_MATCH_OR_ZV,

  /* Move ended at the requested X pixel position.  */
  MOVE_X_REACHED,

  /* Move within a line ended at the end of a line that must be
     continued.  */
  MOVE_LINE_CONTINUED,
  
  /* Move within a line ended at the end of a line that would
     be displayed truncated.  */
  MOVE_LINE_TRUNCATED,

  /* Move within a line ended at a line end.  */
  MOVE_NEWLINE_OR_CR
};


\f
/* Function prototypes.  */

static int string_char_and_length P_ ((unsigned char *, int, int *));
static struct text_pos display_prop_end P_ ((struct it *, Lisp_Object,
                                             struct text_pos));
static int compute_window_start_on_continuation_line P_ ((struct window *));
static Lisp_Object eval_handler P_ ((Lisp_Object));
static Lisp_Object eval_form P_ ((Lisp_Object));
static void insert_left_trunc_glyphs P_ ((struct it *));
static struct glyph_row *get_overlay_arrow_glyph_row P_ ((struct window *));
static void extend_face_to_end_of_line P_ ((struct it *));
static void append_space P_ ((struct it *, int));
static void make_cursor_line_fully_visible P_ ((struct window *));
static int try_scrolling P_ ((Lisp_Object, int, int, int, int));
static int trailing_whitespace_p P_ ((int));
static int message_log_check_duplicate P_ ((int, int, int, int));
int invisible_p P_ ((Lisp_Object, Lisp_Object));
int invisible_ellipsis_p P_ ((Lisp_Object, Lisp_Object));
static void push_it P_ ((struct it *));
static void pop_it P_ ((struct it *));
static void sync_frame_with_window_matrix_rows P_ ((struct window *));
static void redisplay_internal P_ ((int));
static void echo_area_display P_ ((int));
static void redisplay_windows P_ ((Lisp_Object));
static void redisplay_window P_ ((Lisp_Object, int));
static void update_menu_bar P_ ((struct frame *, int));
static int try_window_reusing_current_matrix P_ ((struct window *));
static int try_window_id P_ ((struct window *));
static int display_line P_ ((struct it *));
static void display_mode_lines P_ ((struct window *));
static void display_mode_line P_ ((struct window *, enum face_id,
                                   Lisp_Object));
static int display_mode_element P_ ((struct it *, int, int, int, Lisp_Object));
static char *decode_mode_spec P_ ((struct window *, char, int, int));
static void display_menu_bar P_ ((struct window *));
static int display_count_lines P_ ((int, int, int, int, int *));
static int display_string P_ ((unsigned char *, Lisp_Object, Lisp_Object,
                               int, int, struct it *, int, int, int, int));
static void compute_line_metrics P_ ((struct it *));
static void run_redisplay_end_trigger_hook P_ ((struct it *));
static int get_overlay_strings P_ ((struct it *));
static void next_overlay_string P_ ((struct it *));
void set_iterator_to_next P_ ((struct it *));
static void reseat P_ ((struct it *, struct text_pos, int));
static void reseat_1 P_ ((struct it *, struct text_pos, int));
static void back_to_previous_visible_line_start P_ ((struct it *));
static void reseat_at_previous_visible_line_start P_ ((struct it *));
static int next_element_from_display_vector P_ ((struct it *));
static int next_element_from_string P_ ((struct it *));
static int next_element_from_c_string P_ ((struct it *));
static int next_element_from_buffer P_ ((struct it *));
static int next_element_from_image P_ ((struct it *));
static int next_element_from_stretch P_ ((struct it *));
static void load_overlay_strings P_ ((struct it *));
static void init_from_display_pos P_ ((struct it *, struct window *,
                                       struct display_pos *));
static void reseat_to_string P_ ((struct it *, unsigned char *,
                                  Lisp_Object, int, int, int, int));
static int charset_at_position P_ ((struct text_pos));
static enum move_it_result move_it_in_display_line_to P_ ((struct it *,
                                                           int, int, int));
void move_it_vertically_backward P_ ((struct it *, int));
static void init_to_row_start P_ ((struct it *, struct window *,
                                   struct glyph_row *));
static void init_to_row_end P_ ((struct it *, struct window *,
                                 struct glyph_row *));
static void back_to_previous_line_start P_ ((struct it *));
static void forward_to_next_line_start P_ ((struct it *));
static struct text_pos string_pos_nchars_ahead P_ ((struct text_pos,
                                                    Lisp_Object, int));
static struct text_pos string_pos P_ ((int, Lisp_Object));
static struct text_pos c_string_pos P_ ((int, unsigned char *, int));
static int number_of_chars P_ ((unsigned char *, int));
static void compute_stop_pos P_ ((struct it *));
static void compute_string_pos P_ ((struct text_pos *, struct text_pos,
                                    Lisp_Object));
static int face_before_or_after_it_pos P_ ((struct it *, int));
static int next_overlay_change P_ ((int));
static int handle_single_display_prop P_ ((struct it *, Lisp_Object,
                                           Lisp_Object, struct text_pos *));

#define face_before_it_pos(IT) face_before_or_after_it_pos ((IT), 1)
#define face_after_it_pos(IT)  face_before_or_after_it_pos ((IT), 0)

#ifdef HAVE_WINDOW_SYSTEM

static void update_toolbar P_ ((struct frame *, int));
static void build_desired_toolbar_string P_ ((struct frame *f));
static int redisplay_toolbar P_ ((struct frame *));
static void display_toolbar_line P_ ((struct it *));

#endif /* HAVE_WINDOW_SYSTEM */

\f
/***********************************************************************
                      Window display dimensions
 ***********************************************************************/

/* Return the window-relative maximum y + 1 for glyph rows displaying
   text in window W.  This is the height of W minus the height of a
   mode line, if any.  */

INLINE int
window_text_bottom_y (w)
     struct window *w;
{
  struct frame *f = XFRAME (w->frame);
  int height = XFASTINT (w->height) * CANON_Y_UNIT (f);
  
  if (WINDOW_WANTS_MODELINE_P (w))
    height -= CURRENT_MODE_LINE_HEIGHT (w);
  return height;
}


/* Return the pixel width of display area AREA of window W.  AREA < 0
   means return the total width of W, not including bitmap areas to
   the left and right of the window.  */

INLINE int
window_box_width (w, area)
     struct window *w;
     int area;
{
  struct frame *f = XFRAME (w->frame);
  int width = XFASTINT (w->width);
  
  if (!w->pseudo_window_p)
    {
      width -= FRAME_SCROLL_BAR_WIDTH (f) + 2 * FRAME_FLAGS_AREA_COLS (f);
      
      if (area == TEXT_AREA)
        {
          if (INTEGERP (w->left_margin_width))
            width -= XFASTINT (w->left_margin_width);
          if (INTEGERP (w->right_margin_width))
            width -= XFASTINT (w->right_margin_width);
        }
      else if (area == LEFT_MARGIN_AREA)
        width = (INTEGERP (w->left_margin_width)
                 ? XFASTINT (w->left_margin_width) : 0);
      else if (area == RIGHT_MARGIN_AREA)
        width = (INTEGERP (w->right_margin_width)
                 ? XFASTINT (w->right_margin_width) : 0);
    }

  return width * CANON_X_UNIT (f);
}


/* Return the pixel height of the display area of window W, not
   including mode lines of W, if any..  */

INLINE int
window_box_height (w)
     struct window *w;
{
  struct frame *f = XFRAME (w->frame);
  int height = XFASTINT (w->height) * CANON_Y_UNIT (f);
  
  if (WINDOW_WANTS_MODELINE_P (w))
    height -= CURRENT_MODE_LINE_HEIGHT (w);

  if (WINDOW_WANTS_TOP_LINE_P (w))
    height -= CURRENT_TOP_LINE_HEIGHT (w);

  return height;
}


/* Return the frame-relative coordinate of the left edge of display
   area AREA of window W.  AREA < 0 means return the left edge of the
   whole window, to the right of any bitmap area at the left side of
   W.  */

INLINE int
window_box_left (w, area)
     struct window *w;
     int area;
{
  struct frame *f = XFRAME (w->frame);
  int x = FRAME_INTERNAL_BORDER_WIDTH_SAFE (f);

  if (!w->pseudo_window_p)
    {
      x += (WINDOW_LEFT_MARGIN (w) * CANON_X_UNIT (f)
            + FRAME_FLAGS_AREA_WIDTH (f));
      
      if (area == TEXT_AREA)
        x += window_box_width (w, LEFT_MARGIN_AREA);
      else if (area == RIGHT_MARGIN_AREA)
        x += (window_box_width (w, LEFT_MARGIN_AREA)
              + window_box_width (w, TEXT_AREA));
    }

  return x;
}     


/* Return the frame-relative coordinate of the right edge of display
   area AREA of window W.  AREA < 0 means return the left edge of the
   whole window, to the left of any bitmap area at the right side of
   W.  */

INLINE int
window_box_right (w, area)
     struct window *w;
     int area;
{
  return window_box_left (w, area) + window_box_width (w, area);
}     
     

/* Get the bounding box of the display area AREA of window W, without
   mode lines, in frame-relative coordinates.  AREA < 0 means the
   whole window, not including bitmap areas to the left and right of
   the window.  Return in *BOX_X and *BOX_Y the frame-relative pixel
   coordinates of the upper-left corner of the box.  Return in
   *BOX_WIDTH, and *BOX_HEIGHT the pixel width and height of the box.  */

INLINE void
window_box (w, area, box_x, box_y, box_width, box_height)
     struct window *w;
     int area;
     int *box_x, *box_y, *box_width, *box_height;
{
  struct frame *f = XFRAME (w->frame);
  
  *box_width = window_box_width (w, area);
  *box_height = window_box_height (w);
  *box_x = window_box_left (w, area);
  *box_y = (FRAME_INTERNAL_BORDER_WIDTH_SAFE (f)
            + XFASTINT (w->top) * CANON_Y_UNIT (f));
  if (WINDOW_WANTS_TOP_LINE_P (w))
    *box_y += CURRENT_TOP_LINE_HEIGHT (w);
}


/* Get the bounding box of the display area AREA of window W, without
   mode lines.  AREA < 0 means the whole window, not including bitmap
   areas to the left and right of the window.  Return in *TOP_LEFT_X
   and TOP_LEFT_Y the frame-relative pixel coordinates of the
   upper-left corner of the box.  Return in *BOTTOM_RIGHT_X, and
   *BOTTOM_RIGHT_Y the coordinates of the bottom-right corner of the
   box.  */

INLINE void
window_box_edges (w, area, top_left_x, top_left_y,
                  bottom_right_x, bottom_right_y)
     struct window *w;
     int area;
     int *top_left_x, *top_left_y, *bottom_right_x, *bottom_right_y;
{
  window_box (w, area, top_left_x, top_left_y, bottom_right_x,
              bottom_right_y);
  *bottom_right_x += *top_left_x;
  *bottom_right_y += *top_left_y;
}


\f
/***********************************************************************
                              Utilities
 ***********************************************************************/

/* Return the next character from STR which is MAXLEN bytes long.
   Return in *LEN the length of the character.  This is like
   STRING_CHAR_AND_LENGTH but never returns an invalid character.  If
   we find one, we return a `?', but with the length of the illegal
   character.  */

static INLINE int
string_char_and_length (str, maxlen, len)
     unsigned char *str;
     int maxlen, *len;
{
  int c;

  c = STRING_CHAR_AND_LENGTH (str, maxlen, *len);
  if (!CHAR_VALID_P (c, 1))
    /* We may not change the length here because other places in Emacs
       don't use this function, i.e. they silently accept illegal
       characters.  */
    c = '?';

  return c;
}



/* Given a position POS containing a valid character and byte position
   in STRING, return the position NCHARS ahead (NCHARS >= 0).  */

static struct text_pos
string_pos_nchars_ahead (pos, string, nchars)
     struct text_pos pos;
     Lisp_Object string;
     int nchars;
{
  xassert (STRINGP (string) && nchars >= 0);

  if (STRING_MULTIBYTE (string))
    {
      int rest = STRING_BYTES (XSTRING (string)) - BYTEPOS (pos);
      unsigned char *p = XSTRING (string)->data + BYTEPOS (pos);
      int len;

      while (nchars--)
        {
          string_char_and_length (p, rest, &len);
          p += len, rest -= len;
          xassert (rest >= 0);
          CHARPOS (pos) += 1;
          BYTEPOS (pos) += len;
        }
    }
  else
    SET_TEXT_POS (pos, CHARPOS (pos) + nchars, BYTEPOS (pos) + nchars);

  return pos;
}


/* Value is the text position, i.e. character and byte position,
   for character position CHARPOS in STRING.  */

static INLINE struct text_pos
string_pos (charpos, string)
     int charpos;
     Lisp_Object string;
{
  struct text_pos pos;
  xassert (STRINGP (string));
  xassert (charpos >= 0);
  SET_TEXT_POS (pos, charpos, string_char_to_byte (string, charpos));
  return pos;
}


/* Value is a text position, i.e. character and byte position, for
   character position CHARPOS in C string S.  MULTIBYTE_P non-zero
   means recognize multibyte characters.  */

static struct text_pos
c_string_pos (charpos, s, multibyte_p)
     int charpos;
     unsigned char *s;
     int multibyte_p;
{
  struct text_pos pos;

  xassert (s != NULL);
  xassert (charpos >= 0);

  if (multibyte_p)
    {
      int rest = strlen (s), len;

      SET_TEXT_POS (pos, 0, 0);
      while (charpos--)
        {
          string_char_and_length (s, rest, &len);
          s += len, rest -= len;
          xassert (rest >= 0);
          CHARPOS (pos) += 1;
          BYTEPOS (pos) += len;
        }
    }
  else
    SET_TEXT_POS (pos, charpos, charpos);

  return pos;
}


/* Value is the number of characters in C string S.  MULTIBYTE_P
   non-zero means recognize multibyte characters.  */

static int
number_of_chars (s, multibyte_p)
     unsigned char *s;
     int multibyte_p;
{
  int nchars;
  
  if (multibyte_p)
    {
      int rest = strlen (s), len;
      unsigned char *p = (unsigned char *) s;

      for (nchars = 0; rest > 0; ++nchars)
        {
          string_char_and_length (p, rest, &len);
          rest -= len, p += len;
        }
    }
  else
    nchars = strlen (s);

  return nchars;
}

     
/* Compute byte position NEWPOS->bytepos corresponding to
   NEWPOS->charpos.  POS is a known position in string STRING.
   NEWPOS->charpos must be >= POS.charpos.  */

static void
compute_string_pos (newpos, pos, string)
     struct text_pos *newpos, pos;
     Lisp_Object string;
{
  xassert (STRINGP (string));
  xassert (CHARPOS (*newpos) >= CHARPOS (pos));
  
  if (STRING_MULTIBYTE (string))
    *newpos = string_pos_nchars_ahead (pos, CHARPOS (*newpos) - CHARPOS (pos),
                                       string);
  else
    BYTEPOS (*newpos) = CHARPOS (*newpos);
}


/* Return the charset of the character at position POS in
   current_buffer.  */

static int
charset_at_position (pos)
     struct text_pos pos;
{
  int c, multibyte_p;
  unsigned char *p = BYTE_POS_ADDR (BYTEPOS (pos));

  multibyte_p = !NILP (current_buffer->enable_multibyte_characters);
  if (multibyte_p)
    {
      int maxlen = ((BYTEPOS (pos) >= GPT_BYTE ? ZV_BYTE : GPT_BYTE)
                    - BYTEPOS (pos));
      int len;
      c = string_char_and_length (p, maxlen, &len);
    }
  else
    c = *p;

  return CHAR_CHARSET (c);
}


\f
/***********************************************************************
                        Lisp form evaluation
 ***********************************************************************/

/* Error handler for eval_form.  */

static Lisp_Object
eval_handler (arg)
     Lisp_Object arg;
{
  return Qnil;
}


/* Evaluate SEXPR and return the result, or nil if something went
   wrong.  */

static Lisp_Object
eval_form (sexpr)
     Lisp_Object sexpr;
{
  int count = specpdl_ptr - specpdl;
  Lisp_Object val;
  specbind (Qinhibit_redisplay, Qt);
  val = internal_condition_case_1 (Feval, sexpr, Qerror, eval_handler);
  return unbind_to (count, val);
}


\f
/***********************************************************************
                              Debugging
 ***********************************************************************/

#if 0

/* Define CHECK_IT to perform sanity checks on iterators.
   This is for debugging.  It is too slow to do unconditionally.  */

static void
check_it (it)
     struct it *it;
{
  if (it->method == next_element_from_string)
    {
      xassert (STRINGP (it->string));
      xassert (IT_STRING_CHARPOS (*it) >= 0);
    }
  else if (it->method == next_element_from_buffer)
    {
      /* Check that character and byte positions agree.  */
      xassert (IT_CHARPOS (*it) == BYTE_TO_CHAR (IT_BYTEPOS (*it)));
    }

  if (it->dpvec)
    xassert (it->current.dpvec_index >= 0);
  else
    xassert (it->current.dpvec_index < 0);
}

#define CHECK_IT(IT)    check_it ((IT))

#else /* not 0 */

#define CHECK_IT(IT)    (void) 0

#endif /* not 0 */


#if GLYPH_DEBUG

/* Check that the window end of window W is what we expect it
   to be---the last row in the current matrix displaying text.  */

static void
check_window_end (w)
     struct window *w;
{
  if (!MINI_WINDOW_P (w)
      && !NILP (w->window_end_valid))
    {
      struct glyph_row *row;
      xassert ((row = MATRIX_ROW (w->current_matrix,
                                  XFASTINT (w->window_end_vpos)),
                !row->enabled_p
                || MATRIX_ROW_DISPLAYS_TEXT_P (row)
                || MATRIX_ROW_VPOS (row, w->current_matrix) == 0));
    }
}

#define CHECK_WINDOW_END(W)     check_window_end ((W))

#else /* not GLYPH_DEBUG */

#define CHECK_WINDOW_END(W)     (void) 0

#endif /* not GLYPH_DEBUG */


\f
/***********************************************************************
                       Iterator initialization
 ***********************************************************************/

/* Initialize IT for displaying current_buffer in window W, starting
   at character position CHARPOS.  CHARPOS < 0 means that no buffer
   position is specified which is useful when the iterator is assigned
   a position later.  BYTEPOS is the byte position corresponding to
   CHARPOS.  BYTEPOS <= 0 means compute it from CHARPOS.

   If ROW is not null, calls to produce_glyphs with IT as parameter
   will produce glyphs in that row.

   BASE_FACE_ID is the id of a base face to use.  It must be one of
   DEFAULT_FACE_ID for normal text, MODE_LINE_FACE_ID or
   TOP_LINE_FACE_ID for displaying mode lines, or TOOLBAR_FACE_ID for
   displaying the toolbar.
   
   If ROW is null and BASE_FACE_ID is equal to MODE_LINE_FACE_ID or
   TOP_LINE_FACE_ID, the iterator will be initialized to use the
   corresponding mode line glyph row of the desired matrix of W.  */

void
init_iterator (it, w, charpos, bytepos, row, base_face_id)
     struct it *it;
     struct window *w;
     int charpos, bytepos;
     struct glyph_row *row;
     enum face_id base_face_id;
{
  int highlight_region_p;
  Lisp_Object value;

  /* Some precondition checks.  */
  xassert (w != NULL && it != NULL);
  xassert (charpos < 0 || current_buffer == XBUFFER (w->buffer));
  xassert (charpos < 0 || (charpos > 0 && charpos <= ZV));

  /* If face attributes have been changed since the last redisplay,
     free realized faces now because they depend on face definitions
     that might have changed.  */
  if (face_change_count)
    {
      face_change_count = 0;
      free_all_realized_faces (Qnil);
    }

  /* Use one of the mode line rows of W's desired matrix if
     appropriate.  */
  if (row == NULL)
    {
      if (base_face_id == MODE_LINE_FACE_ID)
        row = MATRIX_MODE_LINE_ROW (w->desired_matrix);
      else if (base_face_id == TOP_LINE_FACE_ID)
        row = MATRIX_TOP_LINE_ROW (w->desired_matrix);
    }
  
  /* Clear IT.  */
  bzero (it, sizeof *it);
  it->current.overlay_string_index = -1;
  it->current.dpvec_index = -1;
  it->charset = CHARSET_ASCII;
  it->base_face_id = base_face_id;

  /* The window in which we iterate over current_buffer:  */
  XSETWINDOW (it->window, w);
  it->w = w;
  it->f = XFRAME (w->frame);

  /* If realized faces have been removed, e.g. because of face
     attribute changes of named faces, recompute them.  */
  if (FRAME_FACE_CACHE (it->f)->used == 0)
    recompute_basic_faces (it->f);

  /* Should we highlight trailing whitespace?  */
  value = find_symbol_value (Qshow_trailing_whitespace);
  it->show_trailing_whitespace_p 
    = EQ (value, Qunbound) ? 0 : !NILP (value);

  /* Current value of the `space-width', and 'height' properties.  */
  it->space_width = Qnil;
  it->font_height = Qnil;
  
  /* Are control characters displayed as `^C'?  */
  it->ctl_arrow_p = !NILP (current_buffer->ctl_arrow);

  /* -1 means everything between a CR and the following line end
     is invisible.  >0 means lines indented more than this value are
     invisible.  */
  it->selective = (INTEGERP (current_buffer->selective_display)
                   ? XFASTINT (current_buffer->selective_display)
                   : (!NILP (current_buffer->selective_display) 
                      ? -1 : 0));
  it->selective_display_ellipsis_p
    = !NILP (current_buffer->selective_display_ellipses);

  /* Display table to use.  */
  it->dp = window_display_table (w);

  /* Are multibyte characters enabled in current_buffer?  */
  it->multibyte_p = !NILP (current_buffer->enable_multibyte_characters);

  /* Non-zero if we should highlight the region.  */
  highlight_region_p
    = (!NILP (Vtransient_mark_mode) 
       && !NILP (current_buffer->mark_active)
       && XMARKER (current_buffer->mark)->buffer != 0);

  /* Set IT->region_beg_charpos and IT->region_end_charpos to the
     start and end of a visible region in window IT->w.  Set both to
     -1 to indicate no region.  */
  if (highlight_region_p
      /* Maybe highlight only in selected window.  */
      && (/* Either show region everywhere.  */ 
          highlight_nonselected_windows
          /* Or show region in the selected window.  */
          || w == XWINDOW (selected_window)
          /* Or show the region if we are in the mini-buffer and W is
             the window the mini-buffer refers to.  */
          || (MINI_WINDOW_P (XWINDOW (selected_window))
              && w == XWINDOW (Vminibuf_scroll_window))))
    {
      int charpos = marker_position (current_buffer->mark);
      it->region_beg_charpos = min (PT, charpos);
      it->region_end_charpos = max (PT, charpos);
    }
  else
    it->region_beg_charpos = it->region_end_charpos = -1;

  /* Get the position at which the redisplay_end_trigger hook should
     be run, if it is to be run at all.  */
  if (MARKERP (w->redisplay_end_trigger)
      && XMARKER (w->redisplay_end_trigger)->buffer != 0)
    it->redisplay_end_trigger_charpos
      = marker_position (w->redisplay_end_trigger);
  else if (INTEGERP (w->redisplay_end_trigger))
    it->redisplay_end_trigger_charpos = XINT (w->redisplay_end_trigger);

  /* Correct bogus values of tab_width.  */
  it->tab_width = XINT (current_buffer->tab_width);
  if (it->tab_width <= 0 || it->tab_width > 1000)
    it->tab_width = 8;

  /* Are lines in the display truncated?  */
  it->truncate_lines_p
    = (base_face_id != DEFAULT_FACE_ID
       || XINT (it->w->hscroll)
       || (truncate_partial_width_windows
           && !WINDOW_FULL_WIDTH_P (it->w))
       || !NILP (current_buffer->truncate_lines));

  /* Get dimensions of truncation and continuation glyphs.  These are
     displayed as bitmaps under X, so we don't need them for such
     frames.  */
  if (!FRAME_WINDOW_P (it->f))
    {
      if (it->truncate_lines_p)
        {
          /* We will need the truncation glyph.  */
          xassert (it->glyph_row == NULL);
          produce_special_glyphs (it, IT_TRUNCATION);
          it->truncation_pixel_width = it->pixel_width;
        }
      else
        {
          /* We will need the continuation glyph.  */
          xassert (it->glyph_row == NULL);
          produce_special_glyphs (it, IT_CONTINUATION);
          it->continuation_pixel_width = it->pixel_width;
        }

      /* Reset these values to zero becaue the produce_special_glyphs
         above has changed them.  */
      it->pixel_width = it->ascent = it->descent = 0;
    }

  /* Set this after getting the dimensions of truncation and
     continuation glyphs, so that we don't produce glyphs when calling
     produce_special_glyphs, above.  */
  it->glyph_row = row;
  it->area = TEXT_AREA;

  /* Get the dimensions of the display area.  The display area
     consists of the visible window area plus a horizontally scrolled
     part to the left of the window.  All x-values are relative to the
     start of this total display area.  */
  if (base_face_id != DEFAULT_FACE_ID)
    {
      /* Mode lines, menu bar in terminal frames.  */
      it->first_visible_x = 0;
      it->last_visible_x = XFASTINT (w->width) * CANON_X_UNIT (it->f);
    }
  else
    {
      it->first_visible_x
        = XFASTINT (it->w->hscroll) * CANON_X_UNIT (it->f);
      it->last_visible_x = (it->first_visible_x
                            + window_box_width (w, TEXT_AREA));

      /* If we truncate lines, leave room for the truncator glyph(s) at
         the right margin.  Otherwise, leave room for the continuation
         glyph(s).  Truncation and continuation glyphs are not inserted
         for window-based redisplay.  */
      if (!FRAME_WINDOW_P (it->f))
        {
          if (it->truncate_lines_p)
            it->last_visible_x -= it->truncation_pixel_width;
          else
            it->last_visible_x -= it->continuation_pixel_width;
        }

      it->top_line_p = WINDOW_WANTS_TOP_LINE_P (w);
      it->current_y = WINDOW_DISPLAY_TOP_LINE_HEIGHT (w) + w->vscroll;
    }

  /* Leave room for a border glyph.  */
  if (!FRAME_WINDOW_P (it->f)
      && !WINDOW_RIGHTMOST_P (it->w))
    it->last_visible_x -= 1;

  it->last_visible_y = window_text_bottom_y (w);

  /* For mode lines and alike, arrange for the first glyph having a
     left box line if the face specifies a box.  */
  if (base_face_id != DEFAULT_FACE_ID)
    {
      struct face *face;
      
      it->face_id = base_face_id;

      /* If we have a boxed mode line, make the first character appear
         with a left box line.  */
      face = FACE_FROM_ID (it->f, base_face_id);
      if (face->box != FACE_NO_BOX)
        it->start_of_box_run_p = 1;
    }

  /* If a buffer position was specified, set the iterator there,
     getting overlays and face properties from that position.  */
  if (charpos > 0)
    {
      it->end_charpos = ZV;
      it->face_id = -1;
      IT_CHARPOS (*it) = charpos;
      
      /* Compute byte position if not specified.  */
      if (bytepos <= 0)
        IT_BYTEPOS (*it) = CHAR_TO_BYTE (charpos);
      else
        IT_BYTEPOS (*it) = bytepos;

      /* Compute faces etc.  */
      reseat (it, it->current.pos, 1);
    }
  
  CHECK_IT (it);
}


/* Initialize IT for the display of window W with window start POS.  */

void
start_display (it, w, pos)
     struct it *it;
     struct window *w;
     struct text_pos pos;
{
  int start_at_line_beg_p;
  struct glyph_row *row;
  int first_vpos = WINDOW_WANTS_TOP_LINE_P (w) ? 1 : 0;
  int first_y;

  row = w->desired_matrix->rows + first_vpos;
  init_iterator (it, w, CHARPOS (pos), BYTEPOS (pos), row, DEFAULT_FACE_ID);
  first_y = it->current_y;
  
  /* If window start is not at a line start, move back to the line
     start.  This makes sure that we take continuation lines into
     account.  */
  start_at_line_beg_p = (CHARPOS (pos) == BEGV
                         || FETCH_BYTE (BYTEPOS (pos) - 1) == '\n');
  if (!start_at_line_beg_p)
    reseat_at_previous_visible_line_start (it);

#if NO_PROMPT_IN_BUFFER
  /* Take the mini-buffer prompt width into account for tab
     calculations.  */
  if (MINI_WINDOW_P (w) && IT_CHARPOS (*it) == BEGV)
    {
      /* Why is mini-buffer_prompt_width guaranteed to be set here?  */
      it->prompt_width = minibuf_prompt_pixel_width;
    }
#endif /* NO_PROMPT_IN_BUFFER */

  /* If window start is not at a line start, skip forward to POS to
     get the correct continuation_lines_width and current_x.  */
  if (!start_at_line_beg_p)
    {
      move_it_to (it, CHARPOS (pos), -1, -1, -1, MOVE_TO_POS);

      /* If lines are continued, this line may end in the middle of a
         multi-glyph character (e.g. a control character displayed as
         \003, or in the middle of an overlay string).  In this case
         move_it_to above will not have taken us to the start of
         the continuation line but to the end of the continued line.  */
      if (!it->truncate_lines_p && it->current_x > 0)
        {
          if (it->current.dpvec_index >= 0
              || it->current.overlay_string_index >= 0)
            {
              set_iterator_to_next (it);
              move_it_in_display_line_to (it, -1, -1, 0);
            }
          it->continuation_lines_width += it->current_x;
        }
      
      it->current_y = first_y;
      it->vpos = 0;
      it->current_x = it->hpos = 0;
    }

#if 0 /* Don't assert the following because start_display is sometimes
         called intentionally with a window start that is not at a
         line start.  Please leave this code in as a comment.  */
  
  /* Window start should be on a line start, now.  */
  xassert (it->continuation_lines_width
           || IT_CHARPOS (it) == BEGV
           || FETCH_BYTE (IT_BYTEPOS (it) - 1) == '\n');
#endif /* 0 */
}


/* Initialize IT for stepping through current_buffer in window W,
   starting at position POS that includes overlay string and display
   vector/ control character translation position information.  */

static void
init_from_display_pos (it, w, pos)
     struct it *it;
     struct window *w;
     struct display_pos *pos;
{
  /* Keep in mind: the call to reseat in init_iterator skips invisible
     text, so we might end up at a position different from POS.  This
     is only a problem when POS is a row start after a newline and an
     overlay starts there with an after-string, and the overlay has an
     invisible property.  Since we don't skip invisible text in
     display_line and elsewhere immediately after consuming the
     newline before the row start, such a POS will not be in a string,
     but the call to init_iterator below will move us to the
     after-string.  */
  init_iterator (it, w, CHARPOS (pos->pos), BYTEPOS (pos->pos),
                 NULL, DEFAULT_FACE_ID);

  /* If position is within an overlay string, set up IT to
     the right overlay string.  */
  if (pos->overlay_string_index >= 0)
    {
      int relative_index;
      
      /* We already have the first chunk of overlay strings in
         IT->overlay_strings.  Load more until the one for
         pos->overlay_string_index is in IT->overlay_strings.  */
      if (pos->overlay_string_index >= OVERLAY_STRING_CHUNK_SIZE)
        {
          int n = pos->overlay_string_index / OVERLAY_STRING_CHUNK_SIZE;
          it->current.overlay_string_index = 0;
          while (n--)
            {
              load_overlay_strings (it);
              it->current.overlay_string_index += OVERLAY_STRING_CHUNK_SIZE;
            }
        }
      
      it->current.overlay_string_index = pos->overlay_string_index;
      relative_index = (it->current.overlay_string_index
                        % OVERLAY_STRING_CHUNK_SIZE);
      it->string = it->overlay_strings[relative_index];
      it->current.string_pos = pos->string_pos;
      it->method = next_element_from_string;
    }
  else if (CHARPOS (pos->string_pos) >= 0)
    {
      /* Recorded position is not in an overlay string, but in another
         string.  This can only be a string from a `display' property.
         IT should already be filled with that string.  */
      it->current.string_pos = pos->string_pos;
      xassert (STRINGP (it->string));
    }

  /* Restore position in display vector translations or control
     character translations.  */
  if (pos->dpvec_index >= 0)
    {
      /* This fills IT->dpvec.  */
      get_next_display_element (it);
      xassert (it->dpvec && it->current.dpvec_index == 0);
      it->current.dpvec_index = pos->dpvec_index;
    }
  
  CHECK_IT (it);
}


/* Initialize IT for stepping through current_buffer in window W
   starting at ROW->start.  */

static void
init_to_row_start (it, w, row)
     struct it *it;
     struct window *w;
     struct glyph_row *row;
{
  init_from_display_pos (it, w, &row->start);
  it->continuation_lines_width = row->continuation_lines_width;
  CHECK_IT (it);
}

     
/* Initialize IT for stepping through current_buffer in window W
   starting in the line following ROW, i.e. starting at ROW->end.  */

static void
init_to_row_end (it, w, row)
     struct it *it;
     struct window *w;
     struct glyph_row *row;
{
  init_from_display_pos (it, w, &row->end);

  if (row->continued_p)
    it->continuation_lines_width = (row->continuation_lines_width
                                    + row->pixel_width);
  CHECK_IT (it);
}



\f
/***********************************************************************
                           Text properties
 ***********************************************************************/

/* Called when IT reaches IT->stop_charpos.  Handle text property and
   overlay changes.  Set IT->stop_charpos to the next position where
   to stop.  */

static void
handle_stop (it)
     struct it *it;
{
  enum prop_handled handled;
  int handle_overlay_change_p = 1;
  struct props *p;

  it->dpvec = NULL;
  it->current.dpvec_index = -1;

  do
    {
      handled = HANDLED_NORMALLY;
      
      /* Call text property handlers.  */
      for (p = it_props; p->handler; ++p)
        {
          handled = p->handler (it);
          
          if (handled == HANDLED_RECOMPUTE_PROPS)
            break;
          else if (handled == HANDLED_RETURN)
            return;
          else if (handled == HANDLED_OVERLAY_STRING_CONSUMED)
            handle_overlay_change_p = 0;
        }

      if (handled != HANDLED_RECOMPUTE_PROPS)
        {
          /* Don't check for overlay strings below when set to deliver
             characters from a display vector.  */
          if (it->method == next_element_from_display_vector)
            handle_overlay_change_p = 0;

          /* Handle overlay changes.  */
          if (handle_overlay_change_p)
            handled = handle_overlay_change (it);
      
          /* Determine where to stop next.  */
          if (handled == HANDLED_NORMALLY)
            compute_stop_pos (it);
        }
    }
  while (handled == HANDLED_RECOMPUTE_PROPS);
}


/* Compute IT->stop_charpos from text property and overlay change
   information for IT's current position.  */

static void
compute_stop_pos (it)
     struct it *it;
{
  register INTERVAL iv, next_iv;
  Lisp_Object object, limit, position;

  /* If nowhere else, stop at the end.  */
  it->stop_charpos = it->end_charpos;
  
  if (STRINGP (it->string))
    {
      /* Strings are usually short, so don't limit the search for
         properties.  */
      object = it->string;
      limit = Qnil;
      XSETFASTINT (position, IT_STRING_CHARPOS (*it));
    }
  else
    {
      int charpos;

      /* If next overlay change is in front of the current stop pos
         (which is IT->end_charpos), stop there.  Note: value of
         next_overlay_change is point-max if no overlay change
         follows.  */
      charpos = next_overlay_change (IT_CHARPOS (*it));
      if (charpos < it->stop_charpos)
        it->stop_charpos = charpos;

      /* If showing the region, we have to stop at the region
         start or end because the face might change there.  */
      if (it->region_beg_charpos > 0)
        {
          if (IT_CHARPOS (*it) < it->region_beg_charpos)
            it->stop_charpos = min (it->stop_charpos, it->region_beg_charpos);
          else if (IT_CHARPOS (*it) < it->region_end_charpos)
            it->stop_charpos = min (it->stop_charpos, it->region_end_charpos);
        }
      
      /* Set up variables for computing the stop position from text
         property changes.  */
      XSETBUFFER (object, current_buffer);
      XSETFASTINT (limit, IT_CHARPOS (*it) + TEXT_PROP_DISTANCE_LIMIT);
      XSETFASTINT (position, IT_CHARPOS (*it));

    }

  /* Get the interval containing IT's position.  Value is a null
     interval if there isn't such an interval.  */
  iv = validate_interval_range (object, &position, &position, 0);
  if (!NULL_INTERVAL_P (iv))
    {
      Lisp_Object values_here[LAST_PROP_IDX];
      struct props *p;

      /* Get properties here.  */
      for (p = it_props; p->handler; ++p)
        values_here[p->idx] = textget (iv->plist, *p->name);

      /* Look for an interval following iv that has different
         properties.  */
      for (next_iv = next_interval (iv);
           (!NULL_INTERVAL_P (next_iv)
            && (NILP (limit)
                || XFASTINT (limit) > next_iv->position));
           next_iv = next_interval (next_iv))
        {
          for (p = it_props; p->handler; ++p)
            {
              Lisp_Object new_value;

              new_value = textget (next_iv->plist, *p->name);
              if (!EQ (values_here[p->idx], new_value))
                break;
            }
          
          if (p->handler)
            break;
        }

      if (!NULL_INTERVAL_P (next_iv))
        {
          if (INTEGERP (limit)
              && next_iv->position >= XFASTINT (limit))
            /* No text property change up to limit.  */
            it->stop_charpos = min (XFASTINT (limit), it->stop_charpos);
          else
            /* Text properties change in next_iv.  */
            it->stop_charpos = min (it->stop_charpos, next_iv->position);
        }
    }

  xassert (STRINGP (it->string)
           || (it->stop_charpos >= BEGV
               && it->stop_charpos >= IT_CHARPOS (*it)));
}


/* Return the position of the next overlay change after POS in
   current_buffer.  Value is point-max if no overlay change
   follows.  This is like `next-overlay-change' but doesn't use
   xmalloc.  */

static int
next_overlay_change (pos)
     int pos;
{
  int noverlays;
  int endpos;
  Lisp_Object *overlays;
  int len;
  int i;

  /* Get all overlays at the given position.  */
  len = 10;
  overlays = (Lisp_Object *) alloca (len * sizeof *overlays);
  noverlays = overlays_at (pos, 0, &overlays, &len, &endpos, NULL);
  if (noverlays > len)
    {
      len = noverlays;
      overlays = (Lisp_Object *) alloca (len * sizeof *overlays);
      noverlays = overlays_at (pos, 0, &overlays, &len, &endpos, NULL);
    }

  /* If any of these overlays ends before endpos,
     use its ending point instead.  */
  for (i = 0; i < noverlays; ++i)
    {
      Lisp_Object oend;
      int oendpos;

      oend = OVERLAY_END (overlays[i]);
      oendpos = OVERLAY_POSITION (oend);
      endpos = min (endpos, oendpos);
    }

  return endpos;
}


\f
/***********************************************************************
                            Fontification
 ***********************************************************************/

/* Handle changes in the `fontified' property of the current buffer by
   calling hook functions from Qfontification_functions to fontify
   regions of text.  */

static enum prop_handled
handle_fontified_prop (it)
     struct it *it;
{
  Lisp_Object prop, pos;
  enum prop_handled handled = HANDLED_NORMALLY;

  /* Get the value of the `fontified' property at IT's current buffer
     position.  (The `fontified' property doesn't have a special
     meaning in strings.)  If the value is nil, call functions from
     Qfontification_functions.  */
  if (!STRINGP (it->string)
      && it->s == NULL
      && !NILP (Vfontification_functions)
      && (pos = make_number (IT_CHARPOS (*it)),
          prop = Fget_char_property (pos, Qfontified, Qnil),
          NILP (prop)))
    {
      Lisp_Object args[2];

      /* Run the hook functions.  */
      args[0] = Qfontification_functions;
      args[1] = pos;
      Frun_hook_with_args (make_number (2), args);

      /* Return HANDLED_RECOMPUTE_PROPS only if function fontified
         something.  This avoids an endless loop if they failed to
         fontify the text for which reason ever.  */
      if (!NILP (Fget_char_property (pos, Qfontified, Qnil)))
        handled = HANDLED_RECOMPUTE_PROPS;
    }

  return handled;
}


\f
/***********************************************************************
                                Faces
 ***********************************************************************/

/* Set up iterator IT from face properties at its current position.
   Called from handle_stop.  */

static enum prop_handled
handle_face_prop (it)
     struct it *it;
{
  int new_face_id, next_stop;
  
  if (!STRINGP (it->string))
    {
      new_face_id
        = face_at_buffer_position (it->w,
                                   IT_CHARPOS (*it),
                                   it->region_beg_charpos,
                                   it->region_end_charpos,
                                   &next_stop,
                                   (IT_CHARPOS (*it)
                                    + TEXT_PROP_DISTANCE_LIMIT),
                                   0);
      
      /* Is this a start of a run of characters with box face?
         Caveat: this can be called for a freshly initialized
         iterator; face_id is -1 is this case.  We know that the new
         face will not change until limit, i.e. if the new face has a
         box, all characters up to limit will have one.  But, as
         usual, we don't know whether limit is really the end.  */
      if (new_face_id != it->face_id)
        {
          struct face *new_face = FACE_FROM_ID (it->f, new_face_id);
          
          /* If new face has a box but old face has not, this is
             the start of a run of characters with box, i.e. it has
             a shadow on the left side.  The value of face_id of the
             iterator will be -1 if this is the initial call that gets
             the face.  In this case, we have to look in front of IT's
             position and see whether there is a face != new_face_id.  */
          it->start_of_box_run_p
            = (new_face->box != FACE_NO_BOX
               && (it->face_id >= 0
                   || IT_CHARPOS (*it) == BEG
                   || new_face_id != face_before_it_pos (it)));
          it->face_box_p = new_face->box != FACE_NO_BOX;
        }
    }
  else
    {
      new_face_id
        = face_at_string_position (it->w,
                                   it->string,
                                   IT_STRING_CHARPOS (*it),
                                   (it->current.overlay_string_index >= 0
                                    ? IT_CHARPOS (*it)
                                    : 0),
                                   it->region_beg_charpos,
                                   it->region_end_charpos,
                                   &next_stop,
                                   it->base_face_id);
      
#if 0 /* This shouldn't be neccessary.  Let's check it.  */
      /* If IT is used to display a mode line we would really like to
         use the mode line face instead of the frame's default face.  */
      if (it->glyph_row == MATRIX_MODE_LINE_ROW (it->w->desired_matrix)
          && new_face_id == DEFAULT_FACE_ID)
        new_face_id = MODE_LINE_FACE_ID;
#endif
      
      /* Is this a start of a run of characters with box?  Caveat:
         this can be called for a freshly allocated iterator; face_id
         is -1 is this case.  We know that the new face will not
         change until the next check pos, i.e. if the new face has a
         box, all characters up to that position will have a
         box.  But, as usual, we don't know whether that position
         is really the end.  */
      if (new_face_id != it->face_id)
        {
          struct face *new_face = FACE_FROM_ID (it->f, new_face_id);
          struct face *old_face = FACE_FROM_ID (it->f, it->face_id);
          
          /* If new face has a box but old face hasn't, this is the
             start of a run of characters with box, i.e. it has a
             shadow on the left side.  */
          it->start_of_box_run_p
            = new_face->box && (old_face == NULL || !old_face->box);
          it->face_box_p = new_face->box != FACE_NO_BOX;
        }
    }
  
  it->face_id = new_face_id;
  it->charset = CHARSET_ASCII;
  return HANDLED_NORMALLY;
}


/* Compute the face one character before or after the current position
   of IT.  BEFORE_P non-zero means get the face in front of IT's
   position.  Value is the id of the face.  */

static int
face_before_or_after_it_pos (it, before_p)
     struct it *it;
     int before_p;
{
  int face_id, limit;
  int next_check_charpos;
  struct text_pos pos;

  xassert (it->s == NULL);
    
  if (STRINGP (it->string))
    {
      /* No face change past the end of the string (for the case
         we are padding with spaces).  No face change before the
         string start.  */
      if (IT_STRING_CHARPOS (*it) >= XSTRING (it->string)->size
          || (IT_STRING_CHARPOS (*it) == 0 && before_p))
        return it->face_id;

      /* Set pos to the position before or after IT's current position.  */
      if (before_p)
        pos = string_pos (IT_STRING_CHARPOS (*it) - 1, it->string);
      else
        pos = string_pos (IT_STRING_CHARPOS (*it) + 1, it->string);

      /* Get the face for ASCII, or unibyte.  */
      face_id
        = face_at_string_position (it->w,
                                   it->string,
                                   CHARPOS (pos),
                                   (it->current.overlay_string_index >= 0
                                    ? IT_CHARPOS (*it)
                                    : 0),
                                   it->region_beg_charpos,
                                   it->region_end_charpos,
                                   &next_check_charpos,
                                   it->base_face_id);

      /* Correct the face for charsets different from ASCII.  Do it
         for the multibyte case only.  The face returned above is
         suitable for unibyte text if IT->string is unibyte.  */
      if (STRING_MULTIBYTE (it->string))
        {
          unsigned char *p = XSTRING (it->string)->data + BYTEPOS (pos);
          int rest = STRING_BYTES (XSTRING (it->string)) - BYTEPOS (pos);
          int c, len, charset;
      
          c = string_char_and_length (p, rest, &len);
          charset = CHAR_CHARSET (c);
          if (charset != CHARSET_ASCII)
            face_id = FACE_FOR_CHARSET (it->f, face_id, charset);
        }
    }
  else
    {
      limit = IT_CHARPOS (*it) + TEXT_PROP_DISTANCE_LIMIT;
      pos = it->current.pos;
      
      if (before_p)
        DEC_TEXT_POS (pos);
      else
        INC_TEXT_POS (pos);
      
      /* Determine face for CHARSET_ASCII, or unibyte.  */
      face_id = face_at_buffer_position (it->w,
                                         CHARPOS (pos),
                                         it->region_beg_charpos,
                                         it->region_end_charpos,
                                         &next_check_charpos,
                                         limit, 0);

      /* Correct the face for charsets different from ASCII.  Do it
         for the multibyte case only.  The face returned above is
         suitable for unibyte text if current_buffer is unibyte.  */
      if (it->multibyte_p)
        {
          int charset = charset_at_position (pos);
          if (charset != CHARSET_ASCII)
            face_id = FACE_FOR_CHARSET (it->f, face_id, charset);
        }
    }
  
  return face_id;
}


\f
/***********************************************************************
                            Invisible text
 ***********************************************************************/

/* Set up iterator IT from invisible properties at its current
   position.  Called from handle_stop.  */

static enum prop_handled
handle_invisible_prop (it)
     struct it *it;
{
  enum prop_handled handled = HANDLED_NORMALLY;

  if (STRINGP (it->string))
    {
      extern Lisp_Object Qinvisible;
      Lisp_Object prop, end_charpos, limit, charpos;

      /* Get the value of the invisible text property at the
         current position.  Value will be nil if there is no such
         property.  */
      XSETFASTINT (charpos, IT_STRING_CHARPOS (*it));
      prop = Fget_text_property (charpos, Qinvisible, it->string);

      if (!NILP (prop))
        {
          handled = HANDLED_RECOMPUTE_PROPS;
          
          /* Get the position at which the next change of the
             invisible text property can be found in IT->string.
             Value will be nil if the property value is the same for
             all the rest of IT->string.  */
          XSETINT (limit, XSTRING (it->string)->size);
          end_charpos = Fnext_single_property_change (charpos, Qinvisible,
                                                  it->string, limit);
          
          /* Text at current position is invisible.  The next
             change in the property is at position end_charpos.
             Move IT's current position to that position.  */
          if (INTEGERP (end_charpos)
              && XFASTINT (end_charpos) < XFASTINT (limit))
            {
              struct text_pos old;
              old = it->current.string_pos;
              IT_STRING_CHARPOS (*it) = XFASTINT (end_charpos);
              compute_string_pos (&it->current.string_pos, old, it->string);
            }
          else
            {
              /* The rest of the string is invisible.  If this is an
                 overlay string, proceed with the next overlay string
                 or whatever comes and return a character from there.  */
              if (it->current.overlay_string_index >= 0)
                {
                  next_overlay_string (it);
                  /* Don't check for overlay strings when we just
                     finished processing them.  */
                  handled = HANDLED_OVERLAY_STRING_CONSUMED;
                }
              else
                {
                  struct Lisp_String *s = XSTRING (it->string);
                  IT_STRING_CHARPOS (*it) = s->size;
                  IT_STRING_BYTEPOS (*it) = STRING_BYTES (s);
                }
            }
        }
    }
  else
    {
      int visible_p, newpos, next_stop;
      Lisp_Object pos, prop;

      /* First of all, is there invisible text at this position?  */
      XSETFASTINT (pos, IT_CHARPOS (*it));
      prop = Fget_char_property (pos, Qinvisible, it->window);
      
      /* If we are on invisible text, skip over it.  */
      if (TEXT_PROP_MEANS_INVISIBLE (prop))
        {
          /* Record whether we have to display an ellipsis for the
             invisible text.  */
          int display_ellipsis_p
            = TEXT_PROP_MEANS_INVISIBLE_WITH_ELLIPSIS (prop);

          handled = HANDLED_RECOMPUTE_PROPS;
          
          /* Loop skipping over invisible text.  The loop is left at
             ZV or with IT on the first char being visible again.  */
          do
            {
              /* Try to skip some invisible text.  Return value is the
                 position reached which can be equal to IT's position
                 if there is nothing invisible here.  This skips both
                 over invisible text properties and overlays with
                 invisible property.  */
              newpos = skip_invisible (IT_CHARPOS (*it),
                                       &next_stop, ZV, it->window);

              /* If we skipped nothing at all we weren't at invisible
                 text in the first place.  If everything to the end of
                 the buffer was skipped, end the loop.  */
              if (newpos == IT_CHARPOS (*it) || newpos >= ZV)
                visible_p = 1;
              else
                {
                  /* We skipped some characters but not necessarily
                     all there are.  Check if we ended up on visible
                     text.  Fget_char_property returns the property of
                     the char before the given position, i.e. if we
                     get visible_p = 1, this means that the char at
                     newpos is visible.  */
                  XSETFASTINT (pos, newpos);
                  prop = Fget_char_property (pos, Qinvisible, it->window);
                  visible_p = !TEXT_PROP_MEANS_INVISIBLE (prop);
                }
              
              /* If we ended up on invisible text, proceed to
                 skip starting with next_stop.  */
              if (!visible_p)
                IT_CHARPOS (*it) = next_stop;
            }
          while (!visible_p);
          
          /* The position newpos is now either ZV or on visible text.  */
          IT_CHARPOS (*it) = newpos;
          IT_BYTEPOS (*it) = CHAR_TO_BYTE (newpos);
          
          /* Maybe return `...' next for the end of the invisible text.  */
          if (display_ellipsis_p)
            {
              if (it->dp 
                  && VECTORP (DISP_INVIS_VECTOR (it->dp)))
                {
                  struct Lisp_Vector *v = XVECTOR (DISP_INVIS_VECTOR (it->dp));
                  it->dpvec = v->contents;
                  it->dpend = v->contents + v->size;
                }
              else 
                {
                  /* Default `...'.  */
                  it->dpvec = default_invis_vector;
                  it->dpend = default_invis_vector + 3;
                }

              /* The ellipsis display does not replace the display of
                 the character at the new position.  Indicate this by
                 setting IT->dpvec_char_len to zero.  */
              it->dpvec_char_len = 0;
              
              it->current.dpvec_index = 0;
              it->method = next_element_from_display_vector;
            }
        }
    }

  return handled;
}


\f
/***********************************************************************
                            'display' property
 ***********************************************************************/

/* Set up iterator IT from `display' property at its current position.
   Called from handle_stop.  */

static enum prop_handled
handle_display_prop (it)
     struct it *it;
{
  Lisp_Object prop, object;
  struct text_pos *position;
  int space_or_image_found_p;

  if (STRINGP (it->string))
    {
      object = it->string;
      position = &it->current.string_pos;
    }
  else
    {
      object = Qnil;
      position = &it->current.pos;
    }

  /* Reset those iterator values set from display property values.  */
  it->font_height = Qnil;
  it->space_width = Qnil;
  it->voffset = 0;

  /* We don't support recursive `display' properties, i.e. string
     values that have a string `display' property, that have a string
     `display' property etc.  */
  if (!it->string_from_display_prop_p)
    it->area = TEXT_AREA;

  prop = Fget_char_property (make_number (position->charpos),
                             Qdisplay, object);
  if (NILP (prop))
    return HANDLED_NORMALLY;

  space_or_image_found_p = 0;
  if (CONSP (prop) && CONSP (XCAR (prop)))
    {
      while (CONSP (prop))
        {
          if (handle_single_display_prop (it, XCAR (prop), object, position))
            space_or_image_found_p = 1;
          prop = XCDR (prop);
        }
    }
  else if (VECTORP (prop))
    {
      int i;
      for (i = 0; i < XVECTOR (prop)->size; ++i)
        if (handle_single_display_prop (it, XVECTOR (prop)->contents[i],
                                        object, position))
          space_or_image_found_p = 1;
    }
  else
    {
      if (handle_single_display_prop (it, prop, object, position))
        space_or_image_found_p = 1;
    }

  return space_or_image_found_p ? HANDLED_RETURN : HANDLED_NORMALLY;
}


/* Value is the position of the end of the `display' property stating
   at START_POS in OBJECT.  */

static struct text_pos
display_prop_end (it, object, start_pos)
     struct it *it;
     Lisp_Object object;
     struct text_pos start_pos;
{
  Lisp_Object end;
  struct text_pos end_pos;
  
  /* Characters having this form of property are not displayed, so
     we have to find the end of the property.  */
  end = Fnext_single_property_change (make_number (start_pos.charpos),
                                      Qdisplay, object, Qnil);
  if (NILP (end))
    {
      /* A nil value of `end' means there are no changes of the
         property to the end of the buffer or string.  */
      if (it->current.overlay_string_index >= 0)
        end_pos.charpos = XSTRING (it->string)->size;
      else
        end_pos.charpos = it->end_charpos;
    }
  else
    end_pos.charpos = XFASTINT (end);

  if (STRINGP (it->string))
    compute_string_pos (&end_pos, start_pos, it->string);
  else
    end_pos.bytepos = CHAR_TO_BYTE (end_pos.charpos);

  return end_pos;
}


/* Set up IT from a single `display' sub-property value PROP.  OBJECT
   is the object in which the `display' property was found.  *POSITION
   is the position at which it was found.

   If PROP is a `space' or `image' sub-property, set *POSITION to the
   end position of the `display' property.

   Value is non-zero if a `space' or `image' property value was found.  */

static int
handle_single_display_prop (it, prop, object, position)
     struct it *it;
     Lisp_Object prop;
     Lisp_Object object;
     struct text_pos *position;
{
  Lisp_Object value;
  int space_or_image_found_p = 0;

  Lisp_Object form;

  /* If PROP is a list of the form `(:when FORM VALUE)', FORM is
     evaluated.  If the result is nil, VALUE is ignored.  */
  form = Qt;
  if (CONSP (prop) && EQ (XCAR (prop), QCwhen))
    {
      prop = XCDR (prop);
      if (!CONSP (prop))
        return 0;
      form = XCAR (prop);
      prop = XCDR (prop);
      if (!CONSP (prop))
        return 0;
      prop = XCAR (prop);
    }

  if (!NILP (form) && !EQ (form, Qt))
    {
      struct gcpro gcpro1;
      struct text_pos end_pos, pt;
      
      end_pos = display_prop_end (it, object, *position);
      GCPRO1 (form);

      /* Temporarily set point to the end position, and then evaluate
         the form.  This makes `(eolp)' work as FORM.  */
      CHARPOS (pt) = PT;
      BYTEPOS (pt) = PT_BYTE;
      TEMP_SET_PT_BOTH (CHARPOS (end_pos), BYTEPOS (end_pos));
      form = eval_form (form);
      TEMP_SET_PT_BOTH (CHARPOS (pt), BYTEPOS (pt));
      UNGCPRO;  
    }
  
  if (NILP (form))
    return 0;

  if (CONSP (prop)
      && EQ (XCAR (prop), Qheight)
      && CONSP (XCDR (prop)))
    {
      if (FRAME_TERMCAP_P (it->f) || FRAME_MSDOS_P (it->f))
        return 0;
      
      /* `(height HEIGHT)'.  */
      it->font_height = XCAR (XCDR (prop));
      if (!NILP (it->font_height))
        {
          struct face *face = FACE_FROM_ID (it->f, it->face_id);
          int new_height = -1;

          if (CONSP (it->font_height)
              && (EQ (XCAR (it->font_height), Qplus)
                  || EQ (XCAR (it->font_height), Qminus))
              && CONSP (XCDR (it->font_height))
              && INTEGERP (XCAR (XCDR (it->font_height))))
            {
              /* `(+ N)' or `(- N)' where N is an integer.  */
              int steps = XINT (XCAR (XCDR (it->font_height)));
              if (EQ (XCAR (it->font_height), Qplus))
                steps = - steps;
              it->face_id = smaller_face (it->f, it->face_id, steps);
            }
          else if (SYMBOLP (it->font_height))
            {
              /* Call function with current height as argument.
                 Value is the new height.  */
              Lisp_Object form, height;
              struct gcpro gcpro1;
              
              height = face->lface[LFACE_HEIGHT_INDEX];
              form = Fcons (it->font_height, Fcons (height, Qnil));
              GCPRO1 (form);
              height = eval_form (form);
              if (NUMBERP (height))
                new_height = XFLOATINT (height);
              UNGCPRO;
            }
          else if (NUMBERP (it->font_height))
            {
              /* Value is a multiple of the canonical char height.  */
              struct face *face;
              
              face = FACE_FROM_ID (it->f, DEFAULT_FACE_ID);
              new_height = (XFLOATINT (it->font_height)
                            * XINT (face->lface[LFACE_HEIGHT_INDEX]));
            }
          else
            {
              /* Evaluate IT->font_height with `height' bound to the
                 current specified height to get the new height.  */
              Lisp_Object value;
              int count = specpdl_ptr - specpdl;
              
              specbind (Qheight, face->lface[LFACE_HEIGHT_INDEX]);
              value = eval_form (it->font_height);
              unbind_to (count, Qnil);
              
              if (NUMBERP (value))
                new_height = XFLOATINT (value);
            }
          
          if (new_height > 0)
            it->face_id = face_with_height (it->f, it->face_id, new_height);
        }
    }
  else if (CONSP (prop)
           && EQ (XCAR (prop), Qspace_width)
           && CONSP (XCDR (prop)))
    {
      /* `(space_width WIDTH)'.  */
      if (FRAME_TERMCAP_P (it->f) || FRAME_MSDOS_P (it->f))
        return 0;
      
      value = XCAR (XCDR (prop));
      if (NUMBERP (value) && XFLOATINT (value) > 0)
        it->space_width = value;
    }
  else if (CONSP (prop)
           && EQ (XCAR (prop), Qraise)
           && CONSP (XCDR (prop)))
    {
#ifdef HAVE_WINDOW_SYSTEM
      /* `(raise FACTOR)'.  */
      if (FRAME_TERMCAP_P (it->f) || FRAME_MSDOS_P (it->f))
        return 0;
      
      value = XCAR (XCDR (prop));
      if (NUMBERP (value))
        {
          struct face *face = FACE_FROM_ID (it->f, it->face_id);
          it->voffset = - (XFLOATINT (value)
                           * (face->font->ascent + face->font->descent));
        }
#endif /* HAVE_WINDOW_SYSTEM */
    }
  else if (!it->string_from_display_prop_p)
    {
      /* `(left-margin VALUE)' or `(right-margin VALUE)
         or `(nil VALUE)' or VALUE.  */
      Lisp_Object location, value;
      struct text_pos start_pos;
      int valid_p;

      /* Characters having this form of property are not displayed, so
         we have to find the end of the property.  */
      space_or_image_found_p = 1;
      start_pos = *position;
      *position = display_prop_end (it, object, start_pos);

      /* Let's stop at the new position and assume that all
         text properties change there.  */
      it->stop_charpos = position->charpos;

      if (CONSP (prop)
          && !EQ (XCAR (prop), Qspace)
          && !EQ (XCAR (prop), Qimage))
        {
          location = XCAR (prop);
          value = XCDR (prop);
        }
      else
        {
          location = Qnil;
          value = prop;
        }

#ifdef HAVE_WINDOW_SYSTEM
      if (FRAME_TERMCAP_P (it->f) || FRAME_MSDOS_P (it->f))
        valid_p = STRINGP (value);
      else
        valid_p = (STRINGP (value)
                   || (CONSP (value) && EQ (XCAR (value), Qspace))
                   || valid_image_p (value));
#else /* not HAVE_WINDOW_SYSTEM */
      valid_p = STRINGP (value);
#endif /* not HAVE_WINDOW_SYSTEM */
      
      if ((EQ (location, Qleft_margin)
           || EQ (location, Qright_margin)
           || NILP (location))
          && valid_p)
        {
          /* Save current settings of IT so that we can restore them
             when we are finished with the glyph property value.  */
          push_it (it);
          
          if (NILP (location))
            it->area = TEXT_AREA;
          else if (EQ (location, Qleft_margin))
            it->area = LEFT_MARGIN_AREA;
          else
            it->area = RIGHT_MARGIN_AREA;
          
          if (STRINGP (value))
            {
              it->string = value;
              it->multibyte_p = STRING_MULTIBYTE (it->string);
              it->current.overlay_string_index = -1;
              IT_STRING_CHARPOS (*it) = IT_STRING_BYTEPOS (*it) = 0;
              it->end_charpos = it->string_nchars
                = XSTRING (it->string)->size;
              it->method = next_element_from_string;
              it->stop_charpos = 0;
              it->string_from_display_prop_p = 1;
            }
          else if (CONSP (value) && EQ (XCAR (value), Qspace))
            {
              it->method = next_element_from_stretch;
              it->object = value;
              it->current.pos = it->position = start_pos;
            }
#ifdef HAVE_WINDOW_SYSTEM
          else
            {
              it->what = IT_IMAGE;
              it->image_id = lookup_image (it->f, value);
              it->position = start_pos;
              it->object = NILP (object) ? it->w->buffer : object;
              it->method = next_element_from_image;
              
              /* Say that we don't have consumed the characters with
                 `display' property yet.  The call to pop_it in
                 set_iterator_to_next will clean this up.  */
              *position = start_pos;
            }
#endif /* HAVE_WINDOW_SYSTEM */
        }
    }

  return space_or_image_found_p;
}


\f
/***********************************************************************
                           Overlay strings
 ***********************************************************************/

/* The following structure is used to record overlay strings for
   later sorting in load_overlay_strings.  */

struct overlay_entry
{
  Lisp_Object string;
  int priority;
  int after_string_p;
};


/* Set up iterator IT from overlay strings at its current position.
   Called from handle_stop.  */

static enum prop_handled
handle_overlay_change (it)
     struct it *it;
{
  /* Overlays are handled in current_buffer only.  */
  if (STRINGP (it->string))
    return HANDLED_NORMALLY;
  else
    return (get_overlay_strings (it)
            ? HANDLED_RECOMPUTE_PROPS
            : HANDLED_NORMALLY);
}


/* Set up the next overlay string for delivery by IT, if there is an
   overlay string to deliver.  Called by set_iterator_to_next when the
   end of the current overlay string is reached.  If there are more
   overlay strings to display, IT->string and
   IT->current.overlay_string_index are set appropriately here.
   Otherwise IT->string is set to nil.  */
   
static void
next_overlay_string (it)
     struct it *it;
{
  ++it->current.overlay_string_index;
  if (it->current.overlay_string_index == it->n_overlay_strings)
    {
      /* No more overlay strings.  Restore IT's settings to what
         they were before overlay strings were processed, and
         continue to deliver from current_buffer.  */
      pop_it (it);
      xassert (it->stop_charpos >= BEGV
               && it->stop_charpos <= it->end_charpos);
      it->string = Qnil;
      it->current.overlay_string_index = -1;
      SET_TEXT_POS (it->current.string_pos, -1, -1);
      it->n_overlay_strings = 0;
      it->method = next_element_from_buffer;
    }
  else
    {
      /* There are more overlay strings to process.  If
         IT->current.overlay_string_index has advanced to a position
         where we must load IT->overlay_strings with more strings, do
         it.  */
      int i = it->current.overlay_string_index % OVERLAY_STRING_CHUNK_SIZE;
  
      if (it->current.overlay_string_index && i == 0)
        load_overlay_strings (it);

      /* Initialize IT to deliver display elements from the overlay
         string.  */
      it->string = it->overlay_strings[i];
      it->multibyte_p = STRING_MULTIBYTE (it->string);
      SET_TEXT_POS (it->current.string_pos, 0, 0);
      it->method = next_element_from_string;
      it->stop_charpos = 0;
    }
  
  CHECK_IT (it);
}


/* Compare two overlay_entry structures E1 and E2.  Used as a
   comparison function for qsort in load_overlay_strings.  Overlay
   strings for the same position are sorted so that

   1. All after-strings come in front of before-strings.
   
   2. Within after-strings, strings are sorted so that overlay strings
   from overlays with higher priorities come first.

   2. Within before-strings, strings are sorted so that overlay
   strings from overlays with higher priorities come last.

   Value is analogous to strcmp.  */

  
static int
compare_overlay_entries (e1, e2)
     void *e1, *e2;
{
  struct overlay_entry *entry1 = (struct overlay_entry *) e1;
  struct overlay_entry *entry2 = (struct overlay_entry *) e2;
  int result;

  if (entry1->after_string_p != entry2->after_string_p)
    /* Let after-strings appear in front of before-strings.  */
    result = entry1->after_string_p ? -1 : 1;
  else if (entry1->after_string_p)
    /* After-strings sorted in order of decreasing priority.  */
    result = entry2->priority - entry1->priority;
  else
    /* Before-strings sorted in order of increasing priority.  */
    result = entry1->priority - entry2->priority;

  return result;
}


/* Load the vector IT->overlay_strings with overlay strings from IT's
   current buffer position.  Set IT->n_overlays to the total number of
   overlay strings found.  

   Overlay strings are processed OVERLAY_STRING_CHUNK_SIZE strings at
   a time.  On entry into load_overlay_strings,
   IT->current.overlay_string_index gives the number of overlay
   strings that have already been loaded by previous calls to this
   function.

   Overlay strings are sorted so that after-string strings come in
   front of before-string strings.  Within before and after-strings,
   strings are sorted by overlay priority.  See also function
   compare_overlay_entries.  */
   
static void
load_overlay_strings (it)
     struct it *it;
{
  extern Lisp_Object Qafter_string, Qbefore_string, Qwindow, Qpriority;
  Lisp_Object ov, overlay, window, str;
  int start, end;
  int size = 20;
  int n = 0, i, j;
  struct overlay_entry *entries
    = (struct overlay_entry *) alloca (size * sizeof *entries);

  /* Append the overlay string STRING of overlay OVERLAY to vector
     `entries' which has size `size' and currently contains `n'
     elements.  AFTER_P non-zero means STRING is an after-string of
     OVERLAY.  */
#define RECORD_OVERLAY_STRING(OVERLAY, STRING, AFTER_P)                 \
  do                                                                    \
    {                                                                   \
      Lisp_Object priority;                                             \
                                                                        \
      if (n == size)                                                    \
        {                                                               \
          int new_size = 2 * size;                                      \
          struct overlay_entry *old = entries;                          \
          entries =                                                     \
            (struct overlay_entry *) alloca (new_size                   \
                                             * sizeof *entries);        \
          bcopy (old, entries, size * sizeof *entries);                 \
          size = new_size;                                              \
        }                                                               \
                                                                        \
      entries[n].string = (STRING);                                     \
      priority = Foverlay_get ((OVERLAY), Qpriority);                   \
      entries[n].priority                                               \
        = INTEGERP (priority) ? XFASTINT (priority) : 0;                \
      entries[n].after_string_p = (AFTER_P);                            \
      ++n;                                                              \
    }                                                                   \
  while (0)

  /* Process overlay before the overlay center.  */
  for (ov = current_buffer->overlays_before;
       CONSP (ov);
       ov = XCONS (ov)->cdr)
    {
      overlay = XCONS (ov)->car;
      xassert (OVERLAYP (overlay));
      start = OVERLAY_POSITION (OVERLAY_START (overlay));
      end = OVERLAY_POSITION (OVERLAY_END (overlay));
      
      if (end < IT_CHARPOS (*it))
        break;

      /* Skip this overlay if it doesn't start or end at IT's current
         position.  */
      if (end != IT_CHARPOS (*it) && start != IT_CHARPOS (*it))
        continue;
      
      /* Skip this overlay if it doesn't apply to IT->w.  */
      window = Foverlay_get (overlay, Qwindow);
      if (WINDOWP (window) && XWINDOW (window) != it->w)
        continue;

      /* If overlay has a non-empty before-string, record it.  */
      if (start == IT_CHARPOS (*it)
          && (str = Foverlay_get (overlay, Qbefore_string), STRINGP (str))
          && XSTRING (str)->size)
        RECORD_OVERLAY_STRING (overlay, str, 0);
      
      /* If overlay has a non-empty after-string, record it.  */
      if (end == IT_CHARPOS (*it)
          && (str = Foverlay_get (overlay, Qafter_string), STRINGP (str))
          && XSTRING (str)->size)
        RECORD_OVERLAY_STRING (overlay, str, 1);
    }
      
  /* Process overlays after the overlay center.  */
  for (ov = current_buffer->overlays_after;
        CONSP (ov);
        ov = XCONS (ov)->cdr)
    {
      overlay = XCONS (ov)->car;
      xassert (OVERLAYP (overlay));
      start = OVERLAY_POSITION (OVERLAY_START (overlay));
      end = OVERLAY_POSITION (OVERLAY_END (overlay));

      if (start > IT_CHARPOS (*it))
        break;
      
      /* Skip this overlay if it doesn't start or end at IT's current
         position.  */
      if (end != IT_CHARPOS (*it) && start != IT_CHARPOS (*it))
        continue;

      /* Skip this overlay if it doesn't apply to IT->w.  */
      window = Foverlay_get (overlay, Qwindow);
      if (WINDOWP (window) && XWINDOW (window) != it->w)
        continue;
      
      /* If overlay has a non-empty before-string, record it.  */
      if (start == IT_CHARPOS (*it)
          && (str = Foverlay_get (overlay, Qbefore_string), STRINGP (str))
          && XSTRING (str)->size)
        RECORD_OVERLAY_STRING (overlay, str, 0);
                               
      /* If overlay has a non-empty after-string, record it.  */
      if (end == IT_CHARPOS (*it)
          && (str = Foverlay_get (overlay, Qafter_string), STRINGP (str))
          && XSTRING (str)->size)
        RECORD_OVERLAY_STRING (overlay, str, 1);
    }

#undef RECORD_OVERLAY_STRING
   
  /* Sort entries.  */
  qsort (entries, n, sizeof *entries, compare_overlay_entries);

  /* Record the total number of strings to process.  */
  it->n_overlay_strings = n;

  /* IT->current.overlay_string_index is the number of overlay strings
     that have already been consumed by IT.  Copy some of the
     remaining overlay strings to IT->overlay_strings.  */
  i = 0;
  j = it->current.overlay_string_index;
  while (i < OVERLAY_STRING_CHUNK_SIZE && j < n)
    it->overlay_strings[i++] = entries[j++].string;
  
  CHECK_IT (it);
}


/* Get the first chunk of overlay strings at IT's current buffer
   position.  Value is non-zero if at least one overlay string was
   found.   */

static int
get_overlay_strings (it)
     struct it *it;
{
  /* Get the first OVERLAY_STRING_CHUNK_SIZE overlay strings to
     process.  This fills IT->overlay_strings with strings, and sets
     IT->n_overlay_strings to the total number of strings to process.
     IT->pos.overlay_string_index has to be set temporarily to zero
     because load_overlay_strings needs this; it must be set to -1
     when no overlay strings are found because a zero value would
     indicate a position in the first overlay string.  */
  it->current.overlay_string_index = 0;
  load_overlay_strings (it);

  /* If we found overlay strings, set up IT to deliver display
     elements from the first one.  Otherwise set up IT to deliver
     from current_buffer.  */
  if (it->n_overlay_strings)
    {
      /* Make sure we know settings in current_buffer, so that we can
         restore meaningful values when we're done with the overlay
         strings.  */
      compute_stop_pos (it);
      xassert (it->face_id >= 0);
      
      /* Save IT's settings.  They are restored after all overlay
         strings have been processed.  */
      xassert (it->sp == 0);
      push_it (it);

      /* Set up IT to deliver display elements from the first overlay
         string.  */
      IT_STRING_CHARPOS (*it) = IT_STRING_BYTEPOS (*it) = 0;
      it->stop_charpos = 0;
      it->string = it->overlay_strings[0];
      it->multibyte_p = STRING_MULTIBYTE (it->string);
      xassert (STRINGP (it->string));
      it->method = next_element_from_string;
    }
  else
    {
      it->string = Qnil;
      it->current.overlay_string_index = -1;
      it->method = next_element_from_buffer;
    }

  CHECK_IT (it);

  /* Value is non-zero if we found at least one overlay string.  */
  return STRINGP (it->string);
}


\f
/***********************************************************************
                      Saving and restoring state
 ***********************************************************************/

/* Save current settings of IT on IT->stack.  Called, for example,
   before setting up IT for an overlay string, to be able to restore
   IT's settings to what they were after the overlay string has been
   processed.  */

static void
push_it (it)
     struct it *it;
{
  struct iterator_stack_entry *p;
  
  xassert (it->sp < 2);
  p = it->stack + it->sp;

  p->stop_charpos = it->stop_charpos;
  xassert (it->face_id >= 0);
  p->face_id = it->face_id;
  p->string = it->string;
  p->pos = it->current;
  p->end_charpos = it->end_charpos;
  p->string_nchars = it->string_nchars;
  p->area = it->area;
  p->multibyte_p = it->multibyte_p;
  p->space_width = it->space_width;
  p->font_height = it->font_height;
  p->voffset = it->voffset;
  p->string_from_display_prop_p = it->string_from_display_prop_p;
  ++it->sp;
}


/* Restore IT's settings from IT->stack.  Called, for example, when no
   more overlay strings must be processed, and we return to delivering
   display elements from a buffer, or when the end of a string from a
   `display' property is reached and we return to delivering display
   elements from an overlay string, or from a buffer.  */

static void
pop_it (it)
     struct it *it;
{
  struct iterator_stack_entry *p;
  
  xassert (it->sp > 0);
  --it->sp;
  p = it->stack + it->sp;
  it->stop_charpos = p->stop_charpos;
  it->face_id = p->face_id;
  it->string = p->string;
  it->current = p->pos;
  it->end_charpos = p->end_charpos;
  it->string_nchars = p->string_nchars;
  it->area = p->area;
  it->multibyte_p = p->multibyte_p;
  it->space_width = p->space_width;
  it->font_height = p->font_height;
  it->voffset = p->voffset;
  it->string_from_display_prop_p = p->string_from_display_prop_p;
}


\f
/***********************************************************************
                          Moving over lines
 ***********************************************************************/

/* Set IT's current position to the previous line start.  */

static void
back_to_previous_line_start (it)
     struct it *it;
{
  IT_CHARPOS (*it) = find_next_newline_no_quit (IT_CHARPOS (*it) - 1, -1);
  IT_BYTEPOS (*it) = CHAR_TO_BYTE (IT_CHARPOS (*it));
}


/* Set IT's current position to the next line start.  */

static void
forward_to_next_line_start (it)
     struct it *it;
{
  IT_CHARPOS (*it) = find_next_newline_no_quit (IT_CHARPOS (*it), 1);
  IT_BYTEPOS (*it) = CHAR_TO_BYTE (IT_CHARPOS (*it));
}


/* Set IT's current position to the previous visible line start.  Skip
   invisible text that is so either due to text properties or due to
   selective display.  Caution: this does not change IT->current_x and
   IT->hpos.  */

static void
back_to_previous_visible_line_start (it)
     struct it *it;
{
  int visible_p = 0;

  /* Go back one newline if not on BEGV already.  */
  if (IT_CHARPOS (*it) > BEGV)
    back_to_previous_line_start (it);

  /* Move over lines that are invisible because of selective display
     or text properties.  */
  while (IT_CHARPOS (*it) > BEGV
         && !visible_p)
    {
      visible_p = 1;

      /* If selective > 0, then lines indented more than that values
         are invisible.  */
      if (it->selective > 0
          && indented_beyond_p (IT_CHARPOS (*it), IT_BYTEPOS (*it),
                                it->selective))
        visible_p = 0;
#ifdef USE_TEXT_PROPERTIES
      else 
        {
          Lisp_Object prop;

          prop = Fget_char_property (IT_CHARPOS (*it), Qinvisible, it->window);
          if (TEXT_PROP_MEANS_INVISIBLE (prop))
            visible_p = 0;
        }
#endif /* USE_TEXT_PROPERTIES  */

      /* Back one more newline if the current one is invisible.  */
      if (!visible_p)
        back_to_previous_line_start (it);
    }

  xassert (IT_CHARPOS (*it) >= BEGV);
  xassert (IT_CHARPOS (*it) == BEGV
           || FETCH_BYTE (IT_BYTEPOS (*it) - 1) == '\n');
  CHECK_IT (it);
}


/* Reseat iterator IT at the previous visible line start.  Skip
   invisible text that is so either due to text properties or due to
   selective display.  At the end, update IT's overlay information,
   face information etc.  */

static void
reseat_at_previous_visible_line_start (it)
     struct it *it;
{
  back_to_previous_visible_line_start (it);
  reseat (it, it->current.pos, 1);
  CHECK_IT (it);
}


/* Reseat iterator IT on the next visible line start in the current
   buffer.  Skip over invisible text that is so because of selective
   display.  Compute faces, overlays etc at the new position.  Note
   that this function does not skip over text that is invisible
   because of text properties.  */

static void
reseat_at_next_visible_line_start (it)
     struct it *it;
{
  /* Restore the buffer position when currently not delivering display
     elements from the current buffer.  This is the case, for example,
     when called at the end of a truncated overlay string.  */
  while (it->sp)
    pop_it (it);
  it->method = next_element_from_buffer;
  
  /* Otherwise, scan_buffer would not work.  */
  if (IT_CHARPOS (*it) < ZV)
    {
      /* If on a newline, advance past it.  Otherwise, find the next
         newline which automatically gives us the position following
         the newline.  */
      if (FETCH_BYTE (IT_BYTEPOS (*it)) == '\n')
        {
          ++IT_CHARPOS (*it);
          ++IT_BYTEPOS (*it);
        }
      else
        forward_to_next_line_start (it);

      /* We must either have reached the end of the buffer or end up
         after a newline.  */
      xassert (IT_CHARPOS (*it) == ZV
               || FETCH_BYTE (IT_BYTEPOS (*it) - 1) == '\n');

      /* Skip over lines that are invisible because they are indented
         more than the value of IT->selective.  */
      if (it->selective > 0)
        while (IT_CHARPOS (*it) < ZV
               && indented_beyond_p (IT_CHARPOS (*it), IT_BYTEPOS (*it),
                                     it->selective))
          forward_to_next_line_start (it);
      
      /* Set the iterator there.  The 0 as the last parameter of
         reseat means don't force a text property lookup.  The lookup
         is then only done if we've skipped past the iterator's
         check_charpos'es.  This optimization is important because
         text property lookups tend to be expensive.  */
      reseat (it, it->current.pos, 0);
    }
  
  CHECK_IT (it);
}


\f
/***********************************************************************
                   Changing an iterator's position
***********************************************************************/

/* Change IT's current position to POS in current_buffer.  If FORCE_P
   is non-zero, always check for text properties at the new position.
   Otherwise, text properties are only looked up if POS >=
   IT->check_charpos of a property.  */

static void
reseat (it, pos, force_p)
     struct it *it;
     struct text_pos pos;
     int force_p;
{
  int original_pos = IT_CHARPOS (*it);

  reseat_1 (it, pos, 0);

  /* Determine where to check text properties.  Avoid doing it
     where possible because text property lookup is very expensive.  */
  if (force_p
      || CHARPOS (pos) > it->stop_charpos
      || CHARPOS (pos) < original_pos)
    handle_stop (it);

  CHECK_IT (it);
}


/* Change IT's buffer position to POS.  SET_STOP_P non-zero means set
   IT->stop_pos to POS, also.  */

static void
reseat_1 (it, pos, set_stop_p)
     struct it *it;
     struct text_pos pos;
     int set_stop_p;
{
  /* Don't call this function when scanning a C string.  */
  xassert (it->s == NULL);

  /* POS must be a reasonable value.  */
  xassert (CHARPOS (pos) >= BEGV && CHARPOS (pos) <= ZV);

  it->current.pos = it->position = pos;
  XSETBUFFER (it->object, current_buffer);
  it->dpvec = NULL;
  it->current.dpvec_index = -1;
  it->current.overlay_string_index = -1;
  IT_STRING_CHARPOS (*it) = -1;
  IT_STRING_BYTEPOS (*it) = -1;
  it->string = Qnil;
  it->method = next_element_from_buffer;
  it->sp = 0;

  if (set_stop_p)
    it->stop_charpos = CHARPOS (pos);
}


/* Set up IT for displaying a string, starting at CHARPOS in window W.
   If S is non-null, it is a C string to iterate over.  Otherwise,
   STRING gives a Lisp string to iterate over.
   
   If PRECISION > 0, don't return more then PRECISION number of
   characters from the string.

   If FIELD_WIDTH > 0, return padding spaces until FIELD_WIDTH
   characters have been returned.  FIELD_WIDTH < 0 means an infinite
   field width.

   MULTIBYTE = 0 means disable processing of multibyte characters,
   MULTIBYTE > 0 means enable it,
   MULTIBYTE < 0 means use IT->multibyte_p.

   IT must be initialized via a prior call to init_iterator before
   calling this function.  */

static void
reseat_to_string (it, s, string, charpos, precision, field_width, multibyte)
     struct it *it;
     unsigned char *s;
     Lisp_Object string;
     int charpos;
     int precision, field_width, multibyte;
{
  /* No region in strings.  */
  it->region_beg_charpos = it->region_end_charpos = -1;

  /* No text property checks performed by default, but see below.  */
  it->stop_charpos = -1;

  /* Set iterator position and end position.  */
  bzero (&it->current, sizeof it->current);
  it->current.overlay_string_index = -1;
  it->current.dpvec_index = -1;
  it->charset = CHARSET_ASCII;
  xassert (charpos >= 0);
  
  /* Use the setting of MULTIBYTE if specified.  */
  if (multibyte >= 0)
    it->multibyte_p = multibyte > 0;
  
  if (s == NULL)
    {
      xassert (STRINGP (string));
      it->string = string;
      it->s = NULL;
      it->end_charpos = it->string_nchars = XSTRING (string)->size;
      it->method = next_element_from_string;
      it->current.string_pos = string_pos (charpos, string);
    }
  else
    {
      it->s = s;
      it->string = Qnil;

      /* Note that we use IT->current.pos, not it->current.string_pos,
         for displaying C strings.  */
      IT_STRING_CHARPOS (*it) = IT_STRING_BYTEPOS (*it) = -1;
      if (it->multibyte_p)
        {
          it->current.pos = c_string_pos (charpos, s, 1);
          it->end_charpos = it->string_nchars = number_of_chars (s, 1);
        }
      else
        {
          IT_CHARPOS (*it) = IT_BYTEPOS (*it) = charpos;
          it->end_charpos = it->string_nchars = strlen (s);
        }
      
      it->method = next_element_from_c_string;
    }

  /* PRECISION > 0 means don't return more than PRECISION characters
     from the string.  */
  if (precision > 0 && it->end_charpos - charpos > precision)
    it->end_charpos = it->string_nchars = charpos + precision;

  /* FIELD_WIDTH > 0 means pad with spaces until FIELD_WIDTH
     characters have been returned.  FIELD_WIDTH == 0 means don't pad,
     FIELD_WIDTH < 0 means infinite field width.  This is useful for
     padding with `-' at the end of a mode line.  */
  if (field_width < 0)
    field_width = INFINITY;
  if (field_width > it->end_charpos - charpos)
    it->end_charpos = charpos + field_width;

  /* Use the standard display table for displaying strings.  */
  if (DISP_TABLE_P (Vstandard_display_table))
    it->dp = XCHAR_TABLE (Vstandard_display_table);

  it->stop_charpos = charpos;
  CHECK_IT (it);
}


\f
/***********************************************************************
                              Iteration
 ***********************************************************************/

/* Load IT's display element fields with information about the next
   display element from the current position of IT.  Value is zero if
   end of buffer (or C string) is reached.  */

int
get_next_display_element (it)
     struct it *it;
{
  /* Non-zero means that we found an display element.  Zero means that
     we hit the end of what we iterate over.  Performance note: the
     function pointer `method' used here turns out to be faster than
     using a sequence of if-statements.  */
  int success_p = (*it->method) (it);
  int charset;

  if (it->what == IT_CHARACTER)
    {
      /* Map via display table or translate control characters.
         IT->c, IT->len etc. have been set to the next character by
         the function call above.  If we have a display table, and it
         contains an entry for IT->c, translate it.  Don't do this if
         IT->c itself comes from a display table, otherwise we could
         end up in an infinite recursion.  (An alternative could be to
         count the recursion depth of this function and signal an
         error when a certain maximum depth is reached.)  Is it worth
         it?  */
      if (success_p && it->dpvec == NULL)
        {
          Lisp_Object dv;

          if (it->dp
              && (dv = DISP_CHAR_VECTOR (it->dp, it->c),
                  VECTORP (dv)))
            {
              struct Lisp_Vector *v = XVECTOR (dv);

              /* Return the first character from the display table
                 entry, if not empty.  If empty, don't display the
                 current character.  */
              if (v->size)
                {
                  it->dpvec_char_len = it->len;
                  it->dpvec = v->contents;
                  it->dpend = v->contents + v->size;
                  it->current.dpvec_index = 0;
                  it->method = next_element_from_display_vector;
                }

              success_p = get_next_display_element (it);
            }

          /* Translate control characters into `\003' or `^C' form.
             Control characters coming from a display table entry are
             currently not translated because we use IT->dpvec to hold
             the translation.  This could easily be changed but I
             don't believe that it is worth doing.  */
          else if ((it->c < ' '
                    && (it->area != TEXT_AREA
                        || (it->c != '\n'
                            && it->c != '\t'
                            && it->c != '\r')))
                   || (it->c >= 127
                       && it->len == 1))
            {
              /* IT->c is a control character which must be displayed
                 either as '\003' or as `^C' where the '\\' and '^'
                 can be defined in the display table.  Fill
                 IT->ctl_chars with glyphs for what we have to
                 display.  Then, set IT->dpvec to these glyphs.  */
              GLYPH g;

              if (it->c < 128 && it->ctl_arrow_p)
                {
                  /* Set IT->ctl_chars[0] to the glyph for `^'.  */
                  if (it->dp
                      && INTEGERP (DISP_CTRL_GLYPH (it->dp))
                      && GLYPH_CHAR_VALID_P (XINT (DISP_CTRL_GLYPH (it->dp))))
                    g = XINT (DISP_CTRL_GLYPH (it->dp));
                  else
                    g = FAST_MAKE_GLYPH ('^', 0);
                  XSETINT (it->ctl_chars[0], g);

                  g = FAST_MAKE_GLYPH (it->c ^ 0100, 0);
                  XSETINT (it->ctl_chars[1], g);

                  /* Set up IT->dpvec and return first character from it.  */
                  it->dpvec_char_len = it->len;
                  it->dpvec = it->ctl_chars;
                  it->dpend = it->dpvec + 2;
                  it->current.dpvec_index = 0;
                  it->method = next_element_from_display_vector;
                  get_next_display_element (it);
                }
              else
                {
                  /* Set IT->ctl_chars[0] to the glyph for `\\'.  */
                  if (it->dp
                      && INTEGERP (DISP_ESCAPE_GLYPH (it->dp))
                      && GLYPH_CHAR_VALID_P (XFASTINT (DISP_ESCAPE_GLYPH (it->dp))))
                    g = XFASTINT (DISP_ESCAPE_GLYPH (it->dp));
                  else
                    g = FAST_MAKE_GLYPH ('\\', 0);
                  XSETINT (it->ctl_chars[0], g);

                  /* Insert three more glyphs into IT->ctl_chars for
                     the octal display of the character.  */
                  g = FAST_MAKE_GLYPH (((it->c >> 6) & 7) + '0', 0); 
                  XSETINT (it->ctl_chars[1], g);
                  g = FAST_MAKE_GLYPH (((it->c >> 3) & 7) + '0', 0); 
                  XSETINT (it->ctl_chars[2], g);
                  g = FAST_MAKE_GLYPH ((it->c & 7) + '0', 0); 
                  XSETINT (it->ctl_chars[3], g);

                  /* Set up IT->dpvec and return the first character
                     from it.  */
                  it->dpvec_char_len = it->len;
                  it->dpvec = it->ctl_chars;
                  it->dpend = it->dpvec + 4;
                  it->current.dpvec_index = 0;
                  it->method = next_element_from_display_vector;
                  get_next_display_element (it);
                }
            }
        }

      /* Adjust face id if charset changes.  There are no charset
         changes in unibyte text because Emacs' charsets are not
         applicable there.  */
      if (it->multibyte_p
          && success_p
          && (charset = CHAR_CHARSET (it->c),
              charset != it->charset))
        {
          it->charset = charset;
          it->face_id = FACE_FOR_CHARSET (it->f, it->face_id, charset);
        }
    }

  /* Is this character the last one of a run of characters with
     box?  If yes, set IT->end_of_box_run_p to 1.  */
  if (it->face_box_p
      && it->s == NULL)
    {
      int face_id;
      struct face *face;

      it->end_of_box_run_p
        = ((face_id = face_after_it_pos (it),
            face_id != it->face_id)
           && (face = FACE_FROM_ID (it->f, face_id),
               face->box == FACE_NO_BOX));
    }

  /* Value is 0 if end of buffer or string reached.  */
  return success_p;
}


/* Move IT to the next display element.

   Functions get_next_display_element and set_iterator_to_next are
   separate because I find this arrangement easier to handle than a
   get_next_display_element function that also increments IT's
   position.  The way it is we can first look at an iterator's current
   display element, decide whether it fits on a line, and if it does,
   increment the iterator position.  The other way around we probably
   would either need a flag indicating whether the iterator has to be
   incremented the next time, or we would have to implement a
   decrement position function which would not be easy to write.  */

void
set_iterator_to_next (it)
     struct it *it;
{
  if (it->method == next_element_from_buffer)
    {
      /* The current display element of IT is a character from
         current_buffer.  Advance in the buffer, and maybe skip over
         invisible lines that are so because of selective display.  */
      if (ITERATOR_AT_END_OF_LINE_P (it))
        reseat_at_next_visible_line_start (it);
      else
        {
          xassert (it->len != 0);
          IT_BYTEPOS (*it) += it->len;
          IT_CHARPOS (*it) += 1;
          xassert (IT_BYTEPOS (*it) == CHAR_TO_BYTE (IT_CHARPOS (*it)));
        }
    }
  else if (it->method == next_element_from_c_string)
    {
      /* Current display element of IT is from a C string.  */
      IT_BYTEPOS (*it) += it->len;
      IT_CHARPOS (*it) += 1;
    }
  else if (it->method == next_element_from_display_vector)
    {
      /* Current display element of IT is from a display table entry.
         Advance in the display table definition.  Reset it to null if
         end reached, and continue with characters from buffers/
         strings.  */
      ++it->current.dpvec_index;
      it->face_id = it->saved_face_id;
      if (it->dpvec + it->current.dpvec_index == it->dpend)
        {
          if (it->s)
            it->method = next_element_from_c_string;
          else if (STRINGP (it->string))
            it->method = next_element_from_string;
          else
            it->method = next_element_from_buffer;

          it->dpvec = NULL;
          it->current.dpvec_index = -1;

          /* Consume the character which was displayed via IT->dpvec.  */
          if (it->dpvec_char_len)
            {
              it->len = it->dpvec_char_len;
              set_iterator_to_next (it);
            }
        }
    }
  else if (it->method == next_element_from_string)
    {
      /* Current display element is a character from a Lisp string.  */
      xassert (it->s == NULL && STRINGP (it->string));
      IT_STRING_BYTEPOS (*it) += it->len;
      IT_STRING_CHARPOS (*it) += 1;
      
    consider_string_end:

      if (it->current.overlay_string_index >= 0)
        {
          /* IT->string is an overlay string.  Advance to the
             next, if there is one.  */
          if (IT_STRING_CHARPOS (*it) >= XSTRING (it->string)->size)
            next_overlay_string (it);
        }
      else
        {
          /* IT->string is not an overlay string.  If we reached
             its end, and there is something on IT->stack, proceed
             with what is on the stack.  This can be either another
             string, this time an overlay string, or a buffer.  */
          if (IT_STRING_CHARPOS (*it) == XSTRING (it->string)->size
              && it->sp > 0)
            {
              pop_it (it);
              if (!STRINGP (it->string))
                it->method = next_element_from_buffer;
            }
        }
    }
  else if (it->method == next_element_from_image
           || it->method == next_element_from_stretch)
    {
      /* The position etc with which we have to proceed are on
         the stack.  The position may be at the end of a string,
         if the `display' property takes up the whole string.  */
      pop_it (it);
      it->image_id = 0;
      if (STRINGP (it->string))
        {
          it->method = next_element_from_string;
          goto consider_string_end;
        }
      else
        it->method = next_element_from_buffer;
    }
  else
    /* There are no other methods defined, so this should be a bug.  */
    abort ();

  /* Reset flags indicating start and end of a sequence of
     characters with box.  */
  it->start_of_box_run_p = it->end_of_box_run_p = 0;
  
  xassert (it->method != next_element_from_string
           || (STRINGP (it->string)
               && IT_STRING_CHARPOS (*it) >= 0));
}


/* Load IT's display element fields with information about the next
   display element which comes from a display table entry or from the
   result of translating a control character to one of the forms `^C'
   or `\003'.  IT->dpvec holds the glyphs to return as characters.  */

static int
next_element_from_display_vector (it)
     struct it *it;
{
  /* Precondition.  */
  xassert (it->dpvec && it->current.dpvec_index >= 0);

  /* Remember the current face id in case glyphs specify faces.
     IT's face is restored in set_iterator_to_next.  */
  it->saved_face_id = it->face_id;
  
  if (INTEGERP (*it->dpvec)
      && GLYPH_CHAR_VALID_P (XFASTINT (*it->dpvec)))
    {
      int lface_id;
      GLYPH g;

      g = XFASTINT (it->dpvec[it->current.dpvec_index]);
      it->c = FAST_GLYPH_CHAR (g);
      it->len = CHAR_LEN (it->c);

      /* The entry may contain a face id to use.  Such a face id is
         the id of a Lisp face, not a realized face.  A face id of
         zero means no face.  */
      lface_id = FAST_GLYPH_FACE (g);
      if (lface_id)
        {
          int face_id = ascii_face_of_lisp_face (it->f, lface_id);
          if (face_id >= 0)
            {
              it->face_id = face_id;
              it->charset = CHARSET_ASCII;
            }
        }
    }
  else
    /* Display table entry is invalid.  Return a space.  */
    it->c = ' ', it->len = 1;

  /* Don't change position and object of the iterator here.  They are
     still the values of the character that had this display table
     entry or was translated, and that's what we want.  */
  it->what = IT_CHARACTER;
  return 1;
}


/* Load IT with the next display element from Lisp string IT->string.
   IT->current.string_pos is the current position within the string.
   If IT->current.overlay_string_index >= 0, the Lisp string is an
   overlay string.  */

static int
next_element_from_string (it)
     struct it *it;
{
  struct text_pos position;

  xassert (STRINGP (it->string));
  xassert (IT_STRING_CHARPOS (*it) >= 0);
  position = it->current.string_pos;

  /* Time to check for invisible text?  */
  if (IT_STRING_CHARPOS (*it) < it->end_charpos
      && IT_STRING_CHARPOS (*it) == it->stop_charpos)
    {
      handle_stop (it);

      /* Since a handler may have changed IT->method, we must
         recurse here.  */
      return get_next_display_element (it);
    }

  if (it->current.overlay_string_index >= 0)
    {
      /* Get the next character from an overlay string.  In overlay
         strings, There is no field width or padding with spaces to
         do.  */
      if (IT_STRING_CHARPOS (*it) >= XSTRING (it->string)->size)
        {
          it->what = IT_EOB;
          return 0;
        }
      else if (STRING_MULTIBYTE (it->string))
        {
          int remaining = (STRING_BYTES (XSTRING (it->string))
                           - IT_STRING_BYTEPOS (*it));
          unsigned char *s = (XSTRING (it->string)->data
                              + IT_STRING_BYTEPOS (*it));
          it->c = string_char_and_length (s, remaining, &it->len);
        }
      else
        {
          it->c = XSTRING (it->string)->data[IT_STRING_BYTEPOS (*it)];
          it->len = 1;
        }
    }
  else
    {
      /* Get the next character from a Lisp string that is not an
         overlay string.  Such strings come from the mode line, for
         example.  We may have to pad with spaces, or truncate the
         string.  See also next_element_from_c_string.  */
      if (IT_STRING_CHARPOS (*it) >= it->end_charpos)
        {
          it->what = IT_EOB;
          return 0;
        }
      else if (IT_STRING_CHARPOS (*it) >= it->string_nchars)
        {
          /* Pad with spaces.  */
          it->c = ' ', it->len = 1;
          CHARPOS (position) = BYTEPOS (position) = -1;
        }
      else if (STRING_MULTIBYTE (it->string))
        {
          int maxlen = (STRING_BYTES (XSTRING (it->string))
                        - IT_STRING_BYTEPOS (*it));
          unsigned char *s = (XSTRING (it->string)->data
                              + IT_STRING_BYTEPOS (*it));
          it->c = string_char_and_length (s, maxlen, &it->len);
        }
      else
        {
          it->c = XSTRING (it->string)->data[IT_STRING_BYTEPOS (*it)];
          it->len = 1;
        }
    }

  /* Record what we have and where it came from.  Note that we store a
     buffer position in IT->position although it could arguably be a
     string position.  */
  it->what = IT_CHARACTER;
  it->object = it->string;
  it->position = position;
  return 1;
}


/* Load IT with next display element from C string IT->s.
   IT->string_nchars is the maximum number of characters to return
   from the string.  IT->end_charpos may be greater than
   IT->string_nchars when this function is called, in which case we
   may have to return padding spaces.  Value is zero if end of string
   reached, including padding spaces.  */

static int
next_element_from_c_string (it)
     struct it *it;
{
  int success_p = 1;
  
  xassert (it->s);
  it->what = IT_CHARACTER;
  BYTEPOS (it->position) = CHARPOS (it->position) = 0;
  it->object = Qnil;
  
  /* IT's position can be greater IT->string_nchars in case a field
     width or precision has been specified when the iterator was
     initialized.  */
  if (IT_CHARPOS (*it) >= it->end_charpos)
    {
      /* End of the game.  */
      it->what = IT_EOB;
      success_p = 0;
    }
  else if (IT_CHARPOS (*it) >= it->string_nchars)
    {
      /* Pad with spaces.  */
      it->c = ' ', it->len = 1;
      BYTEPOS (it->position) = CHARPOS (it->position) = -1;
    }
  else if (it->multibyte_p)
    {
      /* Implementation note: The calls to strlen apparently aren't a
         performance problem because there is no noticeable performance
         difference between Emacs running in unibyte or multibyte mode.  */
      int maxlen = strlen (it->s) - IT_BYTEPOS (*it);
      it->c = string_char_and_length (it->s + IT_BYTEPOS (*it),
                                      maxlen, &it->len);
    }
  else
    it->c = it->s[IT_BYTEPOS (*it)], it->len = 1;
  
  return success_p;
}


/* Set up IT to return characters from an ellipsis, if appropriate.
   The definition of the ellipsis glyphs may come from a display table
   entry.  This function Fills IT with the first glyph from the
   ellipsis if an ellipsis is to be displayed.  */

static void
next_element_from_ellipsis (it)
     struct it *it;
{
  if (it->dp && VECTORP (DISP_INVIS_VECTOR (it->dp)))
    {
      /* Use the display table definition for `...'.  Invalid glyphs
         will be handled by the method returning elements from dpvec.  */
      struct Lisp_Vector *v = XVECTOR (DISP_INVIS_VECTOR (it->dp));
      it->dpvec_char_len = it->len;
      it->dpvec = v->contents;
      it->dpend = v->contents + v->size;
      it->current.dpvec_index = 0;
      it->method = next_element_from_display_vector;
      get_next_display_element (it);
    }
  else if (it->selective_display_ellipsis_p)
    {
      /* Use default `...' which is stored in default_invis_vector.  */
      it->dpvec_char_len = it->len;
      it->dpvec = default_invis_vector;
      it->dpend = default_invis_vector + 3;
      it->current.dpvec_index = 0;
      it->method = next_element_from_display_vector;
      get_next_display_element (it);
    }
}


/* Deliver an image display element.  The iterator IT is already
   filled with image information (done in handle_display_prop).  Value
   is always 1.  */
  

static int
next_element_from_image (it)
     struct it *it;
{
  it->what = IT_IMAGE;
  return 1;
}


/* Fill iterator IT with next display element from a stretch glyph
   property.  IT->object is the value of the text property.  Value is
   always 1.  */

static int
next_element_from_stretch (it)
     struct it *it;
{
  it->what = IT_STRETCH;
  return 1;
}


/* Load IT with the next display element from current_buffer.  Value
   is zero if end of buffer reached.  IT->stop_charpos is the next
   position at which to stop and check for text properties or buffer
   end.  */

static int
next_element_from_buffer (it)
     struct it *it;
{
  int success_p = 1;

  /* Check this assumption, otherwise, we would never enter the
     if-statement, below.  */
  xassert (IT_CHARPOS (*it) >= BEGV
           && IT_CHARPOS (*it) <= it->stop_charpos);

  if (IT_CHARPOS (*it) >= it->stop_charpos)
    {
      if (IT_CHARPOS (*it) >= it->end_charpos)
        {
          int overlay_strings_follow_p;
          
          /* End of the game, except when overlay strings follow that
             haven't been returned yet.  */
          if (it->overlay_strings_at_end_processed_p)
            overlay_strings_follow_p = 0;
          else
            {
              it->overlay_strings_at_end_processed_p = 1;
              overlay_strings_follow_p
                = get_overlay_strings (it);
            }

          if (overlay_strings_follow_p)
            success_p = get_next_display_element (it);
          else
            {
              it->what = IT_EOB;
              it->position = it->current.pos;
              success_p = 0;
            }
        }
      else
        {
          handle_stop (it);
          return get_next_display_element (it);
        }
    }
  else
    {
      /* No face changes, overlays etc. in sight, so just return a
         character from current_buffer.  */
      unsigned char *p;

      /* Maybe run the redisplay end trigger hook.  Performance note:
         This doesn't seem to cost measurable time.  */
      if (it->redisplay_end_trigger_charpos
          && it->glyph_row
          && IT_CHARPOS (*it) >= it->redisplay_end_trigger_charpos)
        run_redisplay_end_trigger_hook (it);

      /* Get the next character, maybe multibyte.  */
      p = BYTE_POS_ADDR (IT_BYTEPOS (*it));
      if (it->multibyte_p)
        {
          int maxlen = ((IT_BYTEPOS (*it) >= GPT_BYTE ? ZV_BYTE : GPT_BYTE)
                        - IT_BYTEPOS (*it));
          it->c = string_char_and_length (p, maxlen, &it->len);
        }
      else
        it->c = *p, it->len = 1;

      /* Record what we have and where it came from.  */
      it->what = IT_CHARACTER;;
      it->object = it->w->buffer;
      it->position = it->current.pos;

      /* Normally we return the character found above, except when we
         really want to return an ellipsis for selective display.  */
      if (it->selective)
        {
          if (it->c == '\n')
            {
              /* A value of selective > 0 means hide lines indented more
                 than that number of columns.  */
              if (it->selective > 0
                  && IT_CHARPOS (*it) + 1 < ZV
                  && indented_beyond_p (IT_CHARPOS (*it) + 1,
                                        IT_BYTEPOS (*it) + 1,
                                        it->selective))
                next_element_from_ellipsis (it);
            }
          else if (it->c == '\r' && it->selective == -1)
            {
              /* A value of selective == -1 means that everything from the
                 CR to the end of the line is invisible, with maybe an
                 ellipsis displayed for it.  */
              next_element_from_ellipsis (it);
            }
        }
    }

  /* Value is zero if end of buffer reached.  */
  xassert (!success_p || it->len > 0);
  return success_p;
}

     
/* Run the redisplay end trigger hook for IT.  */

static void
run_redisplay_end_trigger_hook (it)
     struct it *it;
{
  Lisp_Object args[3];

  /* IT->glyph_row should be non-null, i.e. we should be actually
     displaying something, or otherwise we should not run the hook.  */
  xassert (it->glyph_row);

  /* Set up hook arguments.  */
  args[0] = Qredisplay_end_trigger_functions;
  args[1] = it->window;
  XSETINT (args[2], it->redisplay_end_trigger_charpos);
  it->redisplay_end_trigger_charpos = 0;

  /* Since we are *trying* to run these functions, don't try to run
     them again, even if they get an error.  */
  it->w->redisplay_end_trigger = Qnil;
  Frun_hook_with_args (3, args);
  
  /* Notice if it changed the face of the character we are on.  */
  handle_face_prop (it);
}


\f
/***********************************************************************
             Moving an iterator without producing glyphs
 ***********************************************************************/

/* Move iterator IT to a specified buffer or X position within one
   line on the display without producing glyphs.

   Begin to skip at IT's current position.  Skip to TO_CHARPOS or TO_X
   whichever is reached first.

   TO_CHARPOS <= 0 means no TO_CHARPOS is specified.

   TO_X < 0 means that no TO_X is specified.  TO_X is normally a value
   0 <= TO_X <= IT->last_visible_x.  This means in particular, that
   TO_X includes the amount by which a window is horizontally
   scrolled.

   Value is

   MOVE_POS_MATCH_OR_ZV
     - when TO_POS or ZV was reached.
        
   MOVE_X_REACHED
     -when TO_X was reached before TO_POS or ZV were reached.
        
   MOVE_LINE_CONTINUED
     - when we reached the end of the display area and the line must
     be continued.
                           
   MOVE_LINE_TRUNCATED
     - when we reached the end of the display area and the line is
     truncated.

   MOVE_NEWLINE_OR_CR
     - when we stopped at a line end, i.e. a newline or a CR and selective
     display is on.  */

enum move_it_result
move_it_in_display_line_to (it, to_charpos, to_x, op)
     struct it *it;
     int to_charpos, to_x, op;
{
  enum move_it_result result = MOVE_UNDEFINED;
  struct glyph_row *saved_glyph_row;

  /* Don't produce glyphs in produce_glyphs.  */
  saved_glyph_row = it->glyph_row;
  it->glyph_row = NULL;

#if NO_PROMPT_IN_BUFFER
  /* Take a mini-buffer prompt into account.  */
  if (MINI_WINDOW_P (it->w)
      && IT_CHARPOS (*it) == BEGV)
    {
      it->current_x = minibuf_prompt_pixel_width;
      it->hpos = minibuf_prompt_width;
    }
#endif

  while (1)
    {
      int x, i;
      
      /* Stop when ZV or TO_CHARPOS reached.  */
      if (!get_next_display_element (it)
          || ((op & MOVE_TO_POS) != 0
              && BUFFERP (it->object)
              && IT_CHARPOS (*it) >= to_charpos))
        {
          result = MOVE_POS_MATCH_OR_ZV;
          break;
        }
          
      /* The call to produce_glyphs will get the metrics of the
         display element IT is loaded with.  We record in x the
         x-position before this display element in case it does not
         fit on the line.  */
      x = it->current_x;
      PRODUCE_GLYPHS (it);

      if (it->area != TEXT_AREA)
        {
          set_iterator_to_next (it);
          continue;
        }

      /* The number of glyphs we get back in IT->nglyphs will normally
         be 1 except when IT->c is (i) a TAB, or (ii) a multi-glyph
         character on a terminal frame, or (iii) a line end.  For the
         second case, IT->nglyphs - 1 padding glyphs will be present
         (on X frames, there is only one glyph produced for a
         composite character.

         The behavior implemented below means, for continuation lines,
         that as many spaces of a TAB as fit on the current line are
         displayed there.  For terminal frames, as many glyphs of a
         multi-glyph character are displayed in the current line, too.
         This is what the old redisplay code did, and we keep it that
         way.  Under X, the whole shape of a complex character must
         fit on the line or it will be completely displayed in the
         next line.

         Note that both for tabs and padding glyphs, all glyphs have
         the same width.   */
      if (it->nglyphs)
        {
          /* More than one glyph or glyph doesn't fit on line.  All
             glyphs have the same width.  */
          int single_glyph_width = it->pixel_width / it->nglyphs;
          int new_x;
          
          for (i = 0; i < it->nglyphs; ++i, x = new_x)
            {
              new_x = x + single_glyph_width;

              /* We want to leave anything reaching TO_X to the caller.  */
              if ((op & MOVE_TO_X) && new_x > to_x)
                {
                  it->current_x = x;
                  result = MOVE_X_REACHED;
                  break;
                }
              else if (/* Lines are continued.  */
                       !it->truncate_lines_p
                       && (/* And glyph doesn't fit on the line.  */
                           new_x > it->last_visible_x
                           /* Or it fits exactly and we're on a window
                              system frame.  */
                           || (new_x == it->last_visible_x
                               && FRAME_WINDOW_P (it->f))))
                {
                  if (/* IT->hpos == 0 means the very first glyph
                         doesn't fit on the line, e.g. a wide image.  */
                      it->hpos == 0
                      || (new_x == it->last_visible_x
                          && FRAME_WINDOW_P (it->f)))
                    {
                      ++it->hpos;
                      it->current_x = new_x;
                      if (i == it->nglyphs - 1)
                        set_iterator_to_next (it);
                    }
                  else
                    it->current_x = x;

                  result = MOVE_LINE_CONTINUED;
                  break;
                }
              else if (new_x > it->first_visible_x)
                {
                  /* Glyph is visible.  Increment number of glyphs that
                     would be displayed.  */
                  ++it->hpos;
                }
              else
                {
                  /* Glyph is completely off the left margin of the display 
                     area.  Nothing to do.  */
                }
            }

          if (result != MOVE_UNDEFINED)
            break;
        }
      else if ((op & MOVE_TO_X) && it->current_x >= to_x)
        {
          /* Stop when TO_X specified and reached.  This check is
             necessary here because of lines consisting of a line end,
             only.  The line end will not produce any glyphs and we
             would never get MOVE_X_REACHED.  */
          xassert (it->nglyphs == 0);
          result = MOVE_X_REACHED;
          break;
        }
  
      /* Is this a line end?  If yes, we're done.  */
      if (ITERATOR_AT_END_OF_LINE_P (it))
        {
          result = MOVE_NEWLINE_OR_CR;
          break;
        }
      
      /* The current display element has been consumed.  Advance
         to the next.  */
      set_iterator_to_next (it);
      
      /* Stop if lines are truncated and IT's current x-position is
         past the right edge of the window now.  */
      if (it->truncate_lines_p
          && it->current_x >= it->last_visible_x)
        {
          result = MOVE_LINE_TRUNCATED;
          break;
        }
    }

  /* Restore the iterator settings altered at the beginning of this
     function.  */
  it->glyph_row = saved_glyph_row;
  return result;
}


/* Move IT forward to a specified buffer position TO_CHARPOS, TO_X,
   TO_Y, TO_VPOS.  OP is a bit-mask that specifies where to stop.  See
   the description of enum move_operation_enum.
   
   If TO_CHARPOS is in invisible text, e.g. a truncated part of a
   screen line, this function will set IT to the next position >
   TO_CHARPOS.  */

void
move_it_to (it, to_charpos, to_x, to_y, to_vpos, op)
     struct it *it;
     int to_charpos, to_x, to_y, to_vpos;
     int op;
{
  enum move_it_result skip, skip2 = MOVE_X_REACHED;
  int line_height;

  xassert (XBUFFER (it->w->buffer) == current_buffer);

  while (1)
    {
      if (op & MOVE_TO_VPOS)
        {
          /* If no TO_CHARPOS and no TO_X specified, stop at the
             start of the line TO_VPOS.  */
          if ((op & (MOVE_TO_X | MOVE_TO_POS)) == 0)
            {
              if (it->vpos == to_vpos)
                break;
              skip = move_it_in_display_line_to (it, -1, -1, 0);
            }
          else
            {
              /* TO_VPOS >= 0 means stop at TO_X in the line at
                 TO_VPOS, or at TO_POS, whichever comes first.  */
              skip = move_it_in_display_line_to (it, to_charpos, to_x, op);

              if (skip == MOVE_POS_MATCH_OR_ZV || it->vpos == to_vpos)
                break;
              else if (skip == MOVE_X_REACHED && it->vpos != to_vpos)
                {
                  /* We have reached TO_X but not in the line we want.  */
                  skip = move_it_in_display_line_to (it, to_charpos,
                                                     -1, MOVE_TO_POS);
                  if (skip == MOVE_POS_MATCH_OR_ZV)
                    break;
                }
            }
        }
      else if (op & MOVE_TO_Y)
        {
          struct it it_backup;
          int done_p;
          
          /* TO_Y specified means stop at TO_X in the line containing
             TO_Y---or at TO_CHARPOS if this is reached first.  The
             problem is that we can't really tell whether the line
             contains TO_Y before we have completely scanned it, and
             this may skip past TO_X.  What we do is to first scan to
             TO_X.

             If TO_X is not specified, use a TO_X of zero.  The reason
             is to make the outcome of this function more predictable.
             If we didn't use TO_X == 0, we would stop at the end of
             the line which is probably not what a caller would expect
             to happen.  */
          skip = move_it_in_display_line_to (it, to_charpos,
                                             ((op & MOVE_TO_X)
                                              ? to_x : 0),
                                             (MOVE_TO_X
                                              | (op & MOVE_TO_POS)));

          /* If TO_CHARPOS is reached or ZV, we don't have to do more.  */
          if (skip == MOVE_POS_MATCH_OR_ZV)
            break;
          
          /* If TO_X was reached, we would like to know whether TO_Y
             is in the line.  This can only be said if we know the
             total line height which requires us to scan the rest of
             the line.  */
          done_p = 0;
          if (skip == MOVE_X_REACHED)
            {
              it_backup = *it;
              skip2 = move_it_in_display_line_to (it, to_charpos, -1,
                                                  op & MOVE_TO_POS);
            }

          /* Now, decide whether TO_Y is in this line.  */
          line_height = it->max_ascent + it->max_descent;
          
          if (to_y >= it->current_y
              && to_y < it->current_y + line_height)
            {
              if (skip == MOVE_X_REACHED)
                /* If TO_Y is in this line and TO_X was reached above,
                   we scanned too far.  We have to restore IT's settings
                   to the ones before skipping.  */
                *it = it_backup;
              done_p = 1;
            }
          else if (skip == MOVE_X_REACHED)
            {
              skip = skip2;
              if (skip == MOVE_POS_MATCH_OR_ZV)
                done_p = 1;
            }

          if (done_p)
            break;
        }
      else
        skip = move_it_in_display_line_to (it, to_charpos, -1, MOVE_TO_POS);

      switch (skip)
        {
        case MOVE_POS_MATCH_OR_ZV:
          return;

        case MOVE_NEWLINE_OR_CR:
          set_iterator_to_next (it);
          it->continuation_lines_width = 0;
          break;

        case MOVE_LINE_TRUNCATED:
          it->continuation_lines_width = 0;
          reseat_at_next_visible_line_start (it);
          if ((op & MOVE_TO_POS) != 0
              && IT_CHARPOS (*it) > to_charpos)
            goto out;
          break;

        case MOVE_LINE_CONTINUED:
          it->continuation_lines_width += it->current_x;
          break;

        default:
          abort ();
        }

      /* Reset/increment for the next run.  */
      recenter_overlay_lists (current_buffer, IT_CHARPOS (*it));
      it->current_x = it->hpos = 0;
      it->current_y += it->max_ascent + it->max_descent;
      ++it->vpos;
      last_height = it->max_ascent + it->max_descent;
      last_max_ascent = it->max_ascent;
      it->max_ascent = it->max_descent = 0;
    }
 out:;
}


/* Move iterator IT backward by a specified y-distance DY, DY >= 0.

   If DY > 0, move IT backward at least that many pixels.  DY = 0
   means move IT backward to the preceding line start or BEGV.  This
   function may move over more than DY pixels if IT->current_y - DY
   ends up in the middle of a line; in this case IT->current_y will be
   set to the top of the line moved to.  */

void
move_it_vertically_backward (it, dy)
     struct it *it;
     int dy;
{
  int nlines, h, line_height;
  struct it it2;
  int start_pos = IT_CHARPOS (*it);
  
  xassert (dy >= 0);

  /* Estimate how many newlines we must move back.  */
  nlines = max (1, dy / CANON_Y_UNIT (it->f));

  /* Set the iterator's position that many lines back.  */
  while (nlines-- && IT_CHARPOS (*it) > BEGV)
    back_to_previous_visible_line_start (it);

  /* Reseat the iterator here.  When moving backward, we don't want
     reseat to skip forward over invisible text, set up the iterator
     to deliver from overlay strings at the new position etc.  So,
     use reseat_1 here.  */
  reseat_1 (it, it->current.pos, 1);

  /* We are now surely at a line start.  */
  it->current_x = it->hpos = 0;

  /* Move forward and see what y-distance we moved.  First move to the
     start of the next line so that we get its height.  We need this
     height to be able to tell whether we reached the specified
     y-distance.  */
  it2 = *it;
  it2.max_ascent = it2.max_descent = 0;
  move_it_to (&it2, start_pos, -1, -1, it2.vpos + 1,
              MOVE_TO_POS | MOVE_TO_VPOS);
  xassert (IT_CHARPOS (*it) >= BEGV);
  line_height = it2.max_ascent + it2.max_descent;
  move_it_to (&it2, start_pos, -1, -1, -1, MOVE_TO_POS);
  xassert (IT_CHARPOS (*it) >= BEGV);
  h = it2.current_y - it->current_y;
  nlines = it2.vpos - it->vpos;

  /* Correct IT's y and vpos position.  */
  it->vpos -= nlines;
  it->current_y -= h;
  
  if (dy == 0)
    {
      /* DY == 0 means move to the start of the screen line.  The
         value of nlines is > 0 if continuation lines were involved.  */
      if (nlines > 0)
        move_it_by_lines (it, nlines, 1);
      xassert (IT_CHARPOS (*it) <= start_pos);
    }
  else if (nlines)
    {
      /* The y-position we try to reach.  Note that h has been
         subtracted in front of the if-statement.  */
      int target_y = it->current_y + h - dy;

      /* If we did not reach target_y, try to move further backward if
         we can.  If we moved too far backward, try to move forward.  */
      if (target_y < it->current_y
          && IT_CHARPOS (*it) > BEGV)
        {
          move_it_vertically (it, target_y - it->current_y);
          xassert (IT_CHARPOS (*it) >= BEGV);
        }
      else if (target_y >= it->current_y + line_height
               && IT_CHARPOS (*it) < ZV)
        {
          move_it_vertically (it, target_y - (it->current_y + line_height));
          xassert (IT_CHARPOS (*it) >= BEGV);
        }
    }
}


/* Move IT by a specified amount of pixel lines DY.  DY negative means
   move backwards.  DY = 0 means move to start of screen line.  At the
   end, IT will be on the start of a screen line.  */

void 
move_it_vertically (it, dy)
    struct it *it;
    int dy;
{
  if (dy <= 0)
    move_it_vertically_backward (it, -dy);
  else if (dy > 0)
    {
      move_it_to (it, ZV, -1, it->current_y + dy, -1,
                  MOVE_TO_POS | MOVE_TO_Y);

      /* If buffer ends in ZV without a newline, move to the start of
         the line to satisfy the post-condition.  */
      if (IT_CHARPOS (*it) == ZV
          && FETCH_BYTE (IT_BYTEPOS (*it) - 1) != '\n')
        move_it_by_lines (it, 0, 0);
    }
}


/* Return non-zero if some text between buffer positions START_CHARPOS
   and END_CHARPOS is invisible.  IT->window is the window for text
   property lookup.  */

static int
invisible_text_between_p (it, start_charpos, end_charpos)
     struct it *it;
     int start_charpos, end_charpos;
{
#ifdef USE_TEXT_PROPERTIES
  Lisp_Object prop, limit;
  int invisible_found_p;
  
  xassert (it != NULL && start_charpos <= end_charpos);

  /* Is text at START invisible?  */
  prop = Fget_char_property (make_number (start_charpos), Qinvisible,
                             it->window);
  if (TEXT_PROP_MEANS_INVISIBLE (prop))
    invisible_found_p = 1;
  else
    {
      limit = Fnext_single_property_change (make_number (start_charpos),
                                            Qinvisible,
                                            Fcurrent_buffer (),
                                            make_number (end_charpos));
      invisible_found_p = XFASTINT (limit) < end_charpos;
    }

  return invisible_found_p;
  
#else /* not USE_TEXT_PROPERTIES */
  return 0;
#endif /* not USE_TEXT_PROPERTIES */
}


/* Move IT by a specified number DVPOS of screen lines down.  DVPOS
   negative means move up.  DVPOS == 0 means move to the start of the
   screen line.  NEED_Y_P non-zero means calculate IT->current_y.  If
   NEED_Y_P is zero, IT->current_y will be left unchanged.

   Further optimization ideas: If we would know that IT->f doesn't use
   a face with proportional font, we could be faster for
   truncate-lines nil.  */

void
move_it_by_lines (it, dvpos, need_y_p)
     struct it *it;
     int dvpos, need_y_p;
{
  struct position pos;
  
  if (!FRAME_WINDOW_P (it->f))
    {
      struct text_pos textpos;
      
      /* We can use vmotion on frames without proportional fonts.  */
      pos = *vmotion (IT_CHARPOS (*it), dvpos, it->w);
      SET_TEXT_POS (textpos, pos.bufpos, pos.bytepos);
      reseat (it, textpos, 1);
      it->vpos += pos.vpos;
      it->current_y += pos.vpos;
    }
  else if (dvpos == 0)
    {
      /* DVPOS == 0 means move to the start of the screen line.  */
      move_it_vertically_backward (it, 0);
      xassert (it->current_x == 0 && it->hpos == 0);
    }
  else if (dvpos > 0)
    {
      /* If there are no continuation lines, and if there is no
         selective display, try the simple method of moving forward
         DVPOS newlines, then see where we are.  */
      if (!need_y_p && it->truncate_lines_p && it->selective == 0)
        {
          int shortage = 0, charpos;

          if (FETCH_BYTE (IT_BYTEPOS (*it) == '\n'))
            charpos = IT_CHARPOS (*it) + 1;
          else
            charpos = scan_buffer ('\n', IT_CHARPOS (*it), 0, dvpos,
                                   &shortage, 0);
          
          if (!invisible_text_between_p (it, IT_CHARPOS (*it), charpos))
            {
              struct text_pos pos;
              CHARPOS (pos) = charpos;
              BYTEPOS (pos) = CHAR_TO_BYTE (charpos);
              reseat (it, pos, 1);
              it->vpos += dvpos - shortage;
              it->hpos = it->current_x = 0;
              return;
            }
        }

      move_it_to (it, -1, -1, -1, it->vpos + dvpos, MOVE_TO_VPOS);
    }
  else
    {
      struct it it2;
      int start_charpos, i;

      /* If there are no continuation lines, and if there is no
         selective display, try the simple method of moving backward
         -DVPOS newlines.  */
      if (!need_y_p && it->truncate_lines_p && it->selective == 0)
        {
          int shortage;
          int charpos = IT_CHARPOS (*it);
          int bytepos = IT_BYTEPOS (*it);

          /* If in the middle of a line, go to its start.  */
          if (charpos > BEGV && FETCH_BYTE (bytepos - 1) != '\n')
            {
              charpos = find_next_newline_no_quit (charpos, -1);
              bytepos = CHAR_TO_BYTE (charpos);
            }

          if (charpos == BEGV)
            {
              struct text_pos pos;
              CHARPOS (pos) = charpos;
              BYTEPOS (pos) = bytepos;
              reseat (it, pos, 1);
              it->hpos = it->current_x = 0;
              return;
            }
          else
            {
              charpos = scan_buffer ('\n', charpos - 1, 0, dvpos, &shortage, 0);
              if (!invisible_text_between_p (it, charpos, IT_CHARPOS (*it)))
                {
                  struct text_pos pos;
                  CHARPOS (pos) = charpos;
                  BYTEPOS (pos) = CHAR_TO_BYTE (charpos);
                  reseat (it, pos, 1);
                  it->vpos += dvpos + (shortage ? shortage - 1 : 0);
                  it->hpos = it->current_x = 0;
                  return;
                }
            }
        }

      /* Go back -DVPOS visible lines and reseat the iterator there.  */
      start_charpos = IT_CHARPOS (*it);
      for (i = -dvpos; i && IT_CHARPOS (*it) > BEGV; --i)
        back_to_previous_visible_line_start (it);
      reseat (it, it->current.pos, 1);
      it->current_x = it->hpos = 0;

      /* Above call may have moved too far if continuation lines
         are involved.  Scan forward and see if it did.  */
      it2 = *it;
      it2.vpos = it2.current_y = 0;
      move_it_to (&it2, start_charpos, -1, -1, -1, MOVE_TO_POS);
      it->vpos -= it2.vpos;
      it->current_y -= it2.current_y;
      it->current_x = it->hpos = 0;

      /* If we moved too far, move IT some lines forward.  */
      if (it2.vpos > -dvpos)
        {
          int delta = it2.vpos + dvpos;
          move_it_to (it, -1, -1, -1, it->vpos + delta, MOVE_TO_VPOS);
        }
    }
}


\f
/***********************************************************************
                               Messages
 ***********************************************************************/


/* Output a newline in the *Messages* buffer if "needs" one.  */

void
message_log_maybe_newline ()
{
  if (message_log_need_newline)
    message_dolog ("", 0, 1, 0);
}


/* Add a string M of length LEN to the message log, optionally
   terminated with a newline when NLFLAG is non-zero.  MULTIBYTE, if
   nonzero, means interpret the contents of M as multibyte.  This
   function calls low-level routines in order to bypass text property
   hooks, etc. which might not be safe to run.  */

void
message_dolog (m, len, nlflag, multibyte)
     char *m;
     int len, nlflag, multibyte;
{
  if (!NILP (Vmessage_log_max))
    {
      struct buffer *oldbuf;
      Lisp_Object oldpoint, oldbegv, oldzv;
      int old_windows_or_buffers_changed = windows_or_buffers_changed;
      int point_at_end = 0;
      int zv_at_end = 0;
      Lisp_Object old_deactivate_mark, tem;
      struct gcpro gcpro1, gcpro2, gcpro3, gcpro4;

      old_deactivate_mark = Vdeactivate_mark;
      oldbuf = current_buffer;
      Fset_buffer (Fget_buffer_create (build_string ("*Messages*")));
      current_buffer->undo_list = Qt;

      oldpoint = Fpoint_marker ();
      oldbegv = Fpoint_min_marker ();
      oldzv = Fpoint_max_marker ();
      GCPRO4 (oldpoint, oldbegv, oldzv, old_deactivate_mark);

      if (PT == Z)
        point_at_end = 1;
      if (ZV == Z)
        zv_at_end = 1;

      BEGV = BEG;
      BEGV_BYTE = BEG_BYTE;
      ZV = Z;
      ZV_BYTE = Z_BYTE;
      TEMP_SET_PT_BOTH (Z, Z_BYTE);

      /* Insert the string--maybe converting multibyte to single byte
         or vice versa, so that all the text fits the buffer.  */
      if (multibyte
          && NILP (current_buffer->enable_multibyte_characters))
        {
          int i, c, nbytes;
          unsigned char work[1];
          
          /* Convert a multibyte string to single-byte
             for the *Message* buffer.  */
          for (i = 0; i < len; i += nbytes)
            {
              c = string_char_and_length (m + i, len - i, &nbytes);
              work[0] = (SINGLE_BYTE_CHAR_P (c)
                         ? c
                         : multibyte_char_to_unibyte (c, Qnil));
              insert_1_both (work, 1, 1, 1, 0, 0);
            }
        }
      else if (! multibyte
               && ! NILP (current_buffer->enable_multibyte_characters))
        {
          int i, c, nbytes;
          unsigned char *msg = (unsigned char *) m;
          unsigned char *str, work[4];
          /* Convert a single-byte string to multibyte
             for the *Message* buffer.  */
          for (i = 0; i < len; i++)
            {
              c = unibyte_char_to_multibyte (msg[i]);
              nbytes = CHAR_STRING (c, work, str);
              insert_1_both (work, 1, nbytes, 1, 0, 0);
            }
        }
      else if (len)
        insert_1 (m, len, 1, 0, 0);

      if (nlflag)
        {
          int this_bol, this_bol_byte, prev_bol, prev_bol_byte, dup;
          insert_1 ("\n", 1, 1, 0, 0);

          scan_newline (Z, Z_BYTE, BEG, BEG_BYTE, -2, 0);
          this_bol = PT;
          this_bol_byte = PT_BYTE;

          if (this_bol > BEG)
            {
              scan_newline (PT, PT_BYTE, BEG, BEG_BYTE, -2, 0);
              prev_bol = PT;
              prev_bol_byte = PT_BYTE;

              dup = message_log_check_duplicate (prev_bol, prev_bol_byte,
                                                 this_bol, this_bol_byte);
              if (dup)
                {
                  del_range_both (prev_bol, prev_bol_byte,
                                  this_bol, this_bol_byte, 0);
                  if (dup > 1)
                    {
                      char dupstr[40];
                      int duplen;

                      /* If you change this format, don't forget to also
                         change message_log_check_duplicate.  */
                      sprintf (dupstr, " [%d times]", dup);
                      duplen = strlen (dupstr);
                      TEMP_SET_PT_BOTH (Z - 1, Z_BYTE - 1);
                      insert_1 (dupstr, duplen, 1, 0, 1);
                    }
                }
            }

          if (NATNUMP (Vmessage_log_max))
            {
              scan_newline (Z, Z_BYTE, BEG, BEG_BYTE,
                            -XFASTINT (Vmessage_log_max) - 1, 0);
              del_range_both (BEG, BEG_BYTE, PT, PT_BYTE, 0);
            }
        }
      BEGV = XMARKER (oldbegv)->charpos;
      BEGV_BYTE = marker_byte_position (oldbegv);

      if (zv_at_end)
        {
          ZV = Z;
          ZV_BYTE = Z_BYTE;
        }
      else
        {
          ZV = XMARKER (oldzv)->charpos;
          ZV_BYTE = marker_byte_position (oldzv);
        }

      if (point_at_end)
        TEMP_SET_PT_BOTH (Z, Z_BYTE);
      else
        /* We can't do Fgoto_char (oldpoint) because it will run some
           Lisp code.  */
        TEMP_SET_PT_BOTH (XMARKER (oldpoint)->charpos,
                          XMARKER (oldpoint)->bytepos);

      UNGCPRO;
      free_marker (oldpoint);
      free_marker (oldbegv);
      free_marker (oldzv);

      tem = Fget_buffer_window (Fcurrent_buffer (), Qt);
      set_buffer_internal (oldbuf);
      if (NILP (tem))
        windows_or_buffers_changed = old_windows_or_buffers_changed;
      message_log_need_newline = !nlflag;
      Vdeactivate_mark = old_deactivate_mark;
    }
}


/* We are at the end of the buffer after just having inserted a newline.
   (Note: We depend on the fact we won't be crossing the gap.)
   Check to see if the most recent message looks a lot like the previous one.
   Return 0 if different, 1 if the new one should just replace it, or a
   value N > 1 if we should also append " [N times]".  */

static int
message_log_check_duplicate (prev_bol, prev_bol_byte, this_bol, this_bol_byte)
     int prev_bol, this_bol;
     int prev_bol_byte, this_bol_byte;
{
  int i;
  int len = Z_BYTE - 1 - this_bol_byte;
  int seen_dots = 0;
  unsigned char *p1 = BUF_BYTE_ADDRESS (current_buffer, prev_bol_byte);
  unsigned char *p2 = BUF_BYTE_ADDRESS (current_buffer, this_bol_byte);

  for (i = 0; i < len; i++)
    {
      if (i >= 3 && p1[i-3] == '.' && p1[i-2] == '.' && p1[i-1] == '.'
          && p1[i] != '\n')
        seen_dots = 1;
      if (p1[i] != p2[i])
        return seen_dots;
    }
  p1 += len;
  if (*p1 == '\n')
    return 2;
  if (*p1++ == ' ' && *p1++ == '[')
    {
      int n = 0;
      while (*p1 >= '0' && *p1 <= '9')
        n = n * 10 + *p1++ - '0';
      if (strncmp (p1, " times]\n", 8) == 0)
        return n+1;
    }
  return 0;
}


/* Display an echo area message M with a specified length of LEN
   chars.  The string may include null characters.  If M is 0, clear
   out any existing message, and let the mini-buffer text show through.

   The buffer M must continue to exist until after the echo area gets
   cleared or some other message gets displayed there.  This means do
   not pass text that is stored in a Lisp string; do not pass text in
   a buffer that was alloca'd.  */

void
message2 (m, len, multibyte)
     char *m;
     int len;
     int multibyte;
{
  /* First flush out any partial line written with print.  */
  message_log_maybe_newline ();
  if (m)
    message_dolog (m, len, 1, multibyte);
  message2_nolog (m, len, multibyte);
}


/* The non-logging counterpart of message2.  */

void
message2_nolog (m, len, multibyte)
     char *m;
     int len;
{
  message_enable_multibyte = multibyte;

  if (noninteractive)
    {
      if (noninteractive_need_newline)
        putc ('\n', stderr);
      noninteractive_need_newline = 0;
      if (m)
        fwrite (m, len, 1, stderr);
      if (cursor_in_echo_area == 0)
        fprintf (stderr, "\n");
      fflush (stderr);
    }
  /* A null message buffer means that the frame hasn't really been
     initialized yet.  Error messages get reported properly by
     cmd_error, so this must be just an informative message; toss it.  */
  else if (INTERACTIVE 
           && selected_frame->glyphs_initialized_p
           && FRAME_MESSAGE_BUF (selected_frame))
    {
      Lisp_Object mini_window;
      struct frame *f;

      /* Get the frame containing the mini-buffer
         that the selected frame is using.  */
      mini_window = FRAME_MINIBUF_WINDOW (selected_frame);
      f = XFRAME (WINDOW_FRAME (XWINDOW (mini_window)));

      FRAME_SAMPLE_VISIBILITY (f);
      if (FRAME_VISIBLE_P (selected_frame)
          && ! FRAME_VISIBLE_P (f))
        Fmake_frame_visible (WINDOW_FRAME (XWINDOW (mini_window)));

      if (m)
        {
          echo_area_glyphs = m;
          echo_area_glyphs_length = len;
          echo_area_message = Qnil;

          if (minibuffer_auto_raise)
            Fraise_frame  (WINDOW_FRAME (XWINDOW (mini_window)));
        }
      else
        {
          echo_area_glyphs = previous_echo_glyphs = NULL;
          echo_area_message = previous_echo_area_message = Qnil;
        }

      do_pending_window_change ();
      echo_area_display (1);
      do_pending_window_change ();
      if (frame_up_to_date_hook != 0 && ! gc_in_progress)
        (*frame_up_to_date_hook) (f);
    }
}


/* Display an echo area message M with a specified length of LEN
   chars.  The string may include null characters.  If M is not a
   string, clear out any existing message, and let the mini-buffer
   text show through.  */

void
message3 (m, len, multibyte)
     Lisp_Object m;
     int len;
     int multibyte;
{
  struct gcpro gcpro1;

  GCPRO1 (m);
  
  /* First flush out any partial line written with print.  */
  message_log_maybe_newline ();
  if (STRINGP (m))
    message_dolog (XSTRING (m)->data, len, 1, multibyte);
  message3_nolog (m, len, multibyte);

  UNGCPRO;
}


/* The non-logging version of message3.  */

void
message3_nolog (m, len, multibyte)
     Lisp_Object m;
     int len, multibyte;
{
  message_enable_multibyte = multibyte;

  if (noninteractive)
    {
      if (noninteractive_need_newline)
        putc ('\n', stderr);
      noninteractive_need_newline = 0;
      if (STRINGP (m))
        fwrite (XSTRING (m)->data, len, 1, stderr);
      if (cursor_in_echo_area == 0)
        fprintf (stderr, "\n");
      fflush (stderr);
    }
  /* A null message buffer means that the frame hasn't really been
     initialized yet.  Error messages get reported properly by
     cmd_error, so this must be just an informative message; toss it.  */
  else if (INTERACTIVE 
           && selected_frame->glyphs_initialized_p
           && FRAME_MESSAGE_BUF (selected_frame))
    {
      Lisp_Object mini_window;
      struct frame *f;

      /* Get the frame containing the mini-buffer
         that the selected frame is using.  */
      mini_window = FRAME_MINIBUF_WINDOW (selected_frame);
      f = XFRAME (WINDOW_FRAME (XWINDOW (mini_window)));

      FRAME_SAMPLE_VISIBILITY (f);
      if (FRAME_VISIBLE_P (selected_frame)
          && ! FRAME_VISIBLE_P (f))
        Fmake_frame_visible (WINDOW_FRAME (XWINDOW (mini_window)));

      if (STRINGP (m))
        {
          echo_area_glyphs = NULL;
          echo_area_message = m;
          echo_area_glyphs_length = len;

          if (minibuffer_auto_raise)
            Fraise_frame  (WINDOW_FRAME (XWINDOW (mini_window)));
        }
      else
        {
          echo_area_glyphs = previous_echo_glyphs = NULL;
          echo_area_message = previous_echo_area_message = Qnil;
        }

      do_pending_window_change ();
      echo_area_display (1);
      do_pending_window_change ();
      if (frame_up_to_date_hook != 0 && ! gc_in_progress)
        (*frame_up_to_date_hook) (f);
    }
}


/* Display a null-terminated echo area message M.  If M is 0, clear
   out any existing message, and let the mini-buffer text show through.

   The buffer M must continue to exist until after the echo area gets
   cleared or some other message gets displayed there.  Do not pass
   text that is stored in a Lisp string.  Do not pass text in a buffer
   that was alloca'd.  */

void
message1 (m)
     char *m;
{
  message2 (m, (m ? strlen (m) : 0), 0);
}


/* The non-logging counterpart of message1.  */

void
message1_nolog (m)
     char *m;
{
  message2_nolog (m, (m ? strlen (m) : 0), 0);
}

/* Display a message M which contains a single %s
   which gets replaced with STRING.  */

void
message_with_string (m, string, log)
     char *m;
     Lisp_Object string;
     int log;
{
  if (noninteractive)
    {
      if (m)
        {
          if (noninteractive_need_newline)
            putc ('\n', stderr);
          noninteractive_need_newline = 0;
          fprintf (stderr, m, XSTRING (string)->data);
          if (cursor_in_echo_area == 0)
            fprintf (stderr, "\n");
          fflush (stderr);
        }
    }
  else if (INTERACTIVE)
    {
      /* The frame whose minibuffer we're going to display the message on.
         It may be larger than the selected frame, so we need
         to use its buffer, not the selected frame's buffer.  */
      Lisp_Object mini_window;
      FRAME_PTR f;

      /* Get the frame containing the minibuffer
         that the selected frame is using.  */
      mini_window = FRAME_MINIBUF_WINDOW (selected_frame);
      f = XFRAME (WINDOW_FRAME (XWINDOW (mini_window)));

      /* A null message buffer means that the frame hasn't really been
         initialized yet.  Error messages get reported properly by
         cmd_error, so this must be just an informative message; toss it.  */
      if (FRAME_MESSAGE_BUF (f))
        {
          int len;
          char *a[1];
          a[0] = (char *) XSTRING (string)->data;

          len = doprnt (FRAME_MESSAGE_BUF (f),
                        FRAME_MESSAGE_BUF_SIZE (f), m, (char *)0, 3, a);

          if (log)
            message2 (FRAME_MESSAGE_BUF (f), len,
                      STRING_MULTIBYTE (string));
          else
            message2_nolog (FRAME_MESSAGE_BUF (f), len,
                            STRING_MULTIBYTE (string));

          /* Print should start at the beginning of the message
             buffer next time.  */
          message_buf_print = 0;
        }
    }
}


/* Truncate what will be displayed in the echo area
   the next time we display it--but don't redisplay it now.  */

void
truncate_echo_area (len)
     int len;
{
  /* A null message buffer means that the frame hasn't really been
     initialized yet.  Error messages get reported properly by
     cmd_error, so this must be just an informative message; toss it.  */
  if (!noninteractive && INTERACTIVE && FRAME_MESSAGE_BUF (selected_frame))
    echo_area_glyphs_length = len;
}


/* Nonzero if FRAME_MESSAGE_BUF (selected_frame) is being used by
   print; zero if being used by message.  */

int message_buf_print;


/* Dump an informative message to the minibuf.  If M is 0, clear out
   any existing message, and let the mini-buffer text show through.  */

/* VARARGS 1 */
void
message (m, a1, a2, a3)
     char *m;
     EMACS_INT a1, a2, a3;
{
  if (noninteractive)
    {
      if (m)
        {
          if (noninteractive_need_newline)
            putc ('\n', stderr);
          noninteractive_need_newline = 0;
          fprintf (stderr, m, a1, a2, a3);
          if (cursor_in_echo_area == 0)
            fprintf (stderr, "\n");
          fflush (stderr);
        }
    }
  else if (INTERACTIVE)
    {
      /* The frame whose mini-buffer we're going to display the message
         on.  It may be larger than the selected frame, so we need to
         use its buffer, not the selected frame's buffer.  */
      Lisp_Object mini_window;
      struct frame *f;

      /* Get the frame containing the mini-buffer
         that the selected frame is using.  */
      mini_window = FRAME_MINIBUF_WINDOW (selected_frame);
      f = XFRAME (WINDOW_FRAME (XWINDOW (mini_window)));

      /* A null message buffer means that the frame hasn't really been
         initialized yet.  Error messages get reported properly by
         cmd_error, so this must be just an informative message; toss
         it.  */
      if (FRAME_MESSAGE_BUF (f))
        {
          if (m)
            {
              int len;
#ifdef NO_ARG_ARRAY
              char *a[3];
              a[0] = (char *) a1;
              a[1] = (char *) a2;
              a[2] = (char *) a3;

              len = doprnt (FRAME_MESSAGE_BUF (f),
                            FRAME_MESSAGE_BUF_SIZE (f), m, (char *)0, 3, a);
#else
              len = doprnt (FRAME_MESSAGE_BUF (f),
                            FRAME_MESSAGE_BUF_SIZE (f), m, (char *)0, 3,
                            (char **) &a1);
#endif /* NO_ARG_ARRAY */

              message2 (FRAME_MESSAGE_BUF (f), len, 0);
            }
          else
            message1 (0);

          /* Print should start at the beginning of the message
             buffer next time.  */
          message_buf_print = 0;
        }
    }
}


/* The non-logging version of message.  */

void
message_nolog (m, a1, a2, a3)
     char *m;
     EMACS_INT a1, a2, a3;
{
  Lisp_Object old_log_max;
  old_log_max = Vmessage_log_max;
  Vmessage_log_max = Qnil;
  message (m, a1, a2, a3);
  Vmessage_log_max = old_log_max;
}


/* Display echo_area_message or echo_area_glyphs in the current
   mini-buffer.  */

void
update_echo_area ()
{
  if (STRINGP (echo_area_message))
    message3 (echo_area_message, echo_area_glyphs_length,
              !NILP (current_buffer->enable_multibyte_characters));
  else
    message2 (echo_area_glyphs, echo_area_glyphs_length,
              !NILP (current_buffer->enable_multibyte_characters));
}


/* Redisplay the echo area of selected_frame.  If UPDATE_FRAME_P is
   non-zero update selected_frame.  */

static void
echo_area_display (update_frame_p)
     int update_frame_p;
{
  Lisp_Object mini_window;
  struct window *w;
  struct frame *f;

  mini_window = FRAME_MINIBUF_WINDOW (selected_frame);
  w = XWINDOW (mini_window);
  f = XFRAME (WINDOW_FRAME (w));

  /* Don't display if frame is invisible or not yet initialized.  */
  if (!FRAME_VISIBLE_P (f) 
      || !f->glyphs_initialized_p)
    return;

  /* When Emacs starts, selected_frame may be a visible terminal
     frame, even if we run under a window system.  If we let this
     through, a message would be displayed on the terminal.  */
#ifdef HAVE_WINDOW_SYSTEM
  if (!inhibit_window_system && !FRAME_WINDOW_P (selected_frame))
    return;
#endif /* HAVE_WINDOW_SYSTEM */

  /* Redraw garbaged frames.  */
  if (frame_garbaged)
    {
      /* Old redisplay called redraw_garbaged_frames here which in
         turn called redraw_frame which in turn called clear_frame.
         The call to clear_frame is a source of flickering.  After
         checking the places where SET_FRAME_GARBAGED is called, I
         believe a clear_frame is not necessary.  It should suffice in
         the new redisplay to invalidate all current matrices, and
         ensure a complete redisplay of all windows.  */
      Lisp_Object tail, frame;
      
      FOR_EACH_FRAME (tail, frame)
        {
          struct frame *f = XFRAME (frame);
          
          if (FRAME_VISIBLE_P (f) && FRAME_GARBAGED_P (f))
            {
              clear_current_matrices (f);
              f->garbaged = 0;
            }
        }

      frame_garbaged = 0;
      ++windows_or_buffers_changed;
    }

  if (echo_area_glyphs
      || STRINGP (echo_area_message)
      || minibuf_level == 0)
    {
      struct it it;

      echo_area_window = mini_window;
      clear_glyph_matrix (w->desired_matrix);
      init_iterator (&it, w, -1, -1, w->desired_matrix->rows, DEFAULT_FACE_ID);
      
      if (STRINGP (echo_area_message)
          && echo_area_glyphs_length)
        {
          prepare_desired_row (it.glyph_row);
          display_string (NULL, echo_area_message, Qnil, 0, 0,
                          &it, -1, echo_area_glyphs_length, 0,
                          message_enable_multibyte);
          it.glyph_row->truncated_on_right_p = 0;
          compute_line_metrics (&it);
        }
      else if (echo_area_glyphs
               && echo_area_glyphs_length)
        {
          prepare_desired_row (it.glyph_row);
          display_string (echo_area_glyphs, Qnil, Qnil, 0, 0, &it,
                          -1, echo_area_glyphs_length, 0,
                          message_enable_multibyte);
          it.glyph_row->truncated_on_right_p = 0;
          compute_line_metrics (&it);
        }
      else
        blank_row (w, it.glyph_row, 0);
      
      it.glyph_row->y = it.current_y;
      it.current_y += it.glyph_row->height;

      /* Clear the rest of the lines.  */
      while (it.current_y < it.last_visible_y)
        {
          ++it.glyph_row;
          blank_row (w, it.glyph_row, it.current_y);
          it.current_y += it.glyph_row->height;
        }

      w->must_be_updated_p = 1;
      if (update_frame_p)
        {
          /* Calling update_single_window is faster when we can use
             window-based redisplay.  */
          if (FRAME_WINDOW_P (f))
            {
              update_single_window (w, 1);
              rif->flush_display (f);
            }
          else
            update_frame (f, 1, 1);
        }
    }
  else if (!EQ (mini_window, selected_window))
    windows_or_buffers_changed++;

  /* Prevent redisplay optimization in redisplay_internal by resetting
     this_line_start_pos.  This is done because the mini-buffer now
     displays the message instead of its buffer text.  */
  if (EQ (mini_window, selected_window))
    CHARPOS (this_line_start_pos) = 0;
  
  previous_echo_glyphs = echo_area_glyphs;
  previous_echo_area_message = echo_area_message;
  previous_echo_glyphs_length = echo_area_glyphs_length;
}


\f
/***********************************************************************
                             Frame Titles
 ***********************************************************************/


#ifdef HAVE_WINDOW_SYSTEM

/* A buffer for constructing frame titles in it; allocated from the
   heap in init_xdisp and resized as needed in store_frame_title_char.  */

static char *frame_title_buf;

/* The buffer's end, and a current output position in it.  */

static char *frame_title_buf_end;
static char *frame_title_ptr;


/* Store a single character C for the frame title in frame_title_buf.
   Re-allocate frame_title_buf if necessary.  */

static void
store_frame_title_char (c)
    char c;
{
  /* If output position has reached the end of the allocated buffer,
     double the buffer's size.  */
  if (frame_title_ptr == frame_title_buf_end)
    {
      int len = frame_title_ptr - frame_title_buf;
      int new_size = 2 * len * sizeof *frame_title_buf;
      frame_title_buf = (char *) xrealloc (frame_title_buf, new_size);
      frame_title_buf_end = frame_title_buf + new_size;
      frame_title_ptr = frame_title_buf + len;
    }

  *frame_title_ptr++ = c;
}


/* Store part of a frame title in frame_title_buf, beginning at
   frame_title_ptr.  STR is the string to store.  Do not copy more
   than PRECISION number of bytes from STR; PRECISION <= 0 means copy
   the whole string.  Pad with spaces until FIELD_WIDTH number of
   characters have been copied; FIELD_WIDTH <= 0 means don't pad.
   Called from display_mode_element when it is used to build a frame
   title.  */

static int
store_frame_title (str, field_width, precision)
     unsigned char *str;
     int field_width, precision;
{
  int n = 0;

  /* Copy at most PRECISION chars from STR.  */
  while ((precision <= 0 || n < precision)
         && *str)
    {
      store_frame_title_char (*str++);
      ++n;
    }

  /* Fill up with spaces until FIELD_WIDTH reached.  */
  while (field_width > 0
         && n < field_width)
    {
      store_frame_title_char (' ');
      ++n;
    }

  return n;
}


/* Set the title of FRAME, if it has changed.  The title format is
   Vicon_title_format if FRAME is iconified, otherwise it is
   frame_title_format.  */

static void
x_consider_frame_title (frame)
     Lisp_Object frame;
{
  struct frame *f = XFRAME (frame);

  if (FRAME_WINDOW_P (f)
      || FRAME_MINIBUF_ONLY_P (f)
      || f->explicit_name)
    {
      /* Do we have more than one visible frame on this X display?  */
      Lisp_Object tail;
      Lisp_Object fmt;
      struct buffer *obuf;
      int len;
      struct it it;

      for (tail = Vframe_list; CONSP (tail); tail = XCONS (tail)->cdr)
        {
          struct frame *tf = XFRAME (XCONS (tail)->car);

          if (tf != f 
              && FRAME_KBOARD (tf) == FRAME_KBOARD (f)
              && !FRAME_MINIBUF_ONLY_P (tf)
              && (FRAME_VISIBLE_P (tf) || FRAME_ICONIFIED_P (tf)))
            break;
        }

      /* Set global variable indicating that multiple frames exist.  */
      multiple_frames = CONSP (tail);

      /* Switch to the buffer of selected window of the frame.  Set up
         frame_title_ptr so that display_mode_element will output into it;
         then display the title.  */
      obuf = current_buffer;
      Fset_buffer (XWINDOW (f->selected_window)->buffer);
      fmt = FRAME_ICONIFIED_P (f) ? Vicon_title_format : Vframe_title_format;
      frame_title_ptr = frame_title_buf;
      init_iterator (&it, XWINDOW (f->selected_window), -1, -1,
                     NULL, DEFAULT_FACE_ID);
      len = display_mode_element (&it, 0, -1, -1, fmt);
      frame_title_ptr = NULL;
      set_buffer_internal (obuf);

      /* Set the title only if it's changed.  This avoids consing in
         the common case where it hasn't.  (If it turns out that we've
         already wasted too much time by walking through the list with
         display_mode_element, then we might need to optimize at a
         higher level than this.)  */
      if (! STRINGP (f->name) 
          || STRING_BYTES (XSTRING (f->name)) != len
          || bcmp (frame_title_buf, XSTRING (f->name)->data, len) != 0)
        x_implicitly_set_name (f, make_string (frame_title_buf, len), Qnil);
    }
}

#else /* not HAVE_WINDOW_SYSTEM */

#define frame_title_ptr ((char *)0)
#define store_frame_title(str, mincol, maxcol) 0

#endif /* not HAVE_WINDOW_SYSTEM */



\f
/***********************************************************************
                              Menu Bars
 ***********************************************************************/


/* Prepare for redisplay by updating menu-bar item lists when
   appropriate.  This can call eval.  */

void
prepare_menu_bars ()
{
  int all_windows;
  struct gcpro gcpro1, gcpro2;
  struct frame *f;
  struct frame *tooltip_frame;

#ifdef HAVE_X_WINDOWS
  tooltip_frame = tip_frame;
#else
  tooltip_frame = NULL;
#endif

  /* Update all frame titles based on their buffer names, etc.  We do
     this before the menu bars so that the buffer-menu will show the
     up-to-date frame titles.  */
#ifdef HAVE_WINDOW_SYSTEM
  if (windows_or_buffers_changed || update_mode_lines)
    {
      Lisp_Object tail, frame;

      FOR_EACH_FRAME (tail, frame)
        {
          f = XFRAME (frame);
          if (f != tooltip_frame
              && (FRAME_VISIBLE_P (f) || FRAME_ICONIFIED_P (f)))
            x_consider_frame_title (frame);
        }
    }
#endif /* HAVE_WINDOW_SYSTEM */

  /* Update the menu bar item lists, if appropriate.  This has to be
     done before any actual redisplay or generation of display lines.  */
  all_windows = (update_mode_lines 
                 || buffer_shared > 1
                 || windows_or_buffers_changed);
  if (all_windows)
    {
      Lisp_Object tail, frame;
      int count = specpdl_ptr - specpdl;

      record_unwind_protect (Fset_match_data, Fmatch_data (Qnil, Qnil));

      FOR_EACH_FRAME (tail, frame)
        {
          f = XFRAME (frame);

          /* Ignore tooltip frame.  */
          if (f == tooltip_frame)
            continue;
          
          /* If a window on this frame changed size, report that to
             the user and clear the size-change flag.  */
          if (FRAME_WINDOW_SIZES_CHANGED (f))
            {
              Lisp_Object functions;
              
              /* Clear flag first in case we get an error below.  */
              FRAME_WINDOW_SIZES_CHANGED (f) = 0;
              functions = Vwindow_size_change_functions;
              GCPRO2 (tail, functions);
              
              while (CONSP (functions))
                {
                  call1 (XCAR (functions), frame);
                  functions = XCDR (functions);
                }
              UNGCPRO;
            }
          
          GCPRO1 (tail);
          update_menu_bar (f, 0);
#ifdef HAVE_WINDOW_SYSTEM
          update_toolbar (f, 0);
#endif
          UNGCPRO;
        }

      unbind_to (count, Qnil);
    }
  else
    {
      update_menu_bar (selected_frame, 1);
#ifdef HAVE_WINDOW_SYSTEM
      update_toolbar (selected_frame, 1);
#endif
    }

  /* Motif needs this.  See comment in xmenu.c.  Turn it off when
     pending_menu_activation is not defined.  */
#ifdef USE_X_TOOLKIT
  pending_menu_activation = 0;
#endif
}


/* Update the menu bar item list for frame F.  This has to be done
   before we start to fill in any display lines, because it can call
   eval.

   If SAVE_MATCH_DATA is non-zero, we must save and restore it here.  */

static void
update_menu_bar (f, save_match_data)
     struct frame *f;
     int save_match_data;
{
  Lisp_Object window;
  register struct window *w;

  window = FRAME_SELECTED_WINDOW (f);
  w = XWINDOW (window);
  
  if (update_mode_lines)
    w->update_mode_line = Qt;

  if (FRAME_WINDOW_P (f)
      ?
#if defined (USE_X_TOOLKIT) || defined (HAVE_NTGUI)
      FRAME_EXTERNAL_MENU_BAR (f) 
#else
      FRAME_MENU_BAR_LINES (f) > 0
#endif
      : FRAME_MENU_BAR_LINES (f) > 0)
    {
      /* If the user has switched buffers or windows, we need to
         recompute to reflect the new bindings.  But we'll
         recompute when update_mode_lines is set too; that means
         that people can use force-mode-line-update to request
         that the menu bar be recomputed.  The adverse effect on
         the rest of the redisplay algorithm is about the same as
         windows_or_buffers_changed anyway.  */
      if (windows_or_buffers_changed
          || !NILP (w->update_mode_line)
          || ((BUF_SAVE_MODIFF (XBUFFER (w->buffer))
               < BUF_MODIFF (XBUFFER (w->buffer)))
              != !NILP (w->last_had_star))
          || ((!NILP (Vtransient_mark_mode)
               && !NILP (XBUFFER (w->buffer)->mark_active))
              != !NILP (w->region_showing)))
        {
          struct buffer *prev = current_buffer;
          int count = specpdl_ptr - specpdl;

          set_buffer_internal_1 (XBUFFER (w->buffer));
          if (save_match_data)
            record_unwind_protect (Fset_match_data, Fmatch_data (Qnil, Qnil));
          if (NILP (Voverriding_local_map_menu_flag))
            {
              specbind (Qoverriding_terminal_local_map, Qnil);
              specbind (Qoverriding_local_map, Qnil);
            }

          /* Run the Lucid hook.  */
          call1 (Vrun_hooks, Qactivate_menubar_hook);
          
          /* If it has changed current-menubar from previous value,
             really recompute the menu-bar from the value.  */
          if (! NILP (Vlucid_menu_bar_dirty_flag))
            call0 (Qrecompute_lucid_menubar);
          
          safe_run_hooks (Qmenu_bar_update_hook);
          FRAME_MENU_BAR_ITEMS (f) = menu_bar_items (FRAME_MENU_BAR_ITEMS (f));
          
          /* Redisplay the menu bar in case we changed it.  */
#if defined (USE_X_TOOLKIT) || defined (HAVE_NTGUI)
          if (FRAME_WINDOW_P (f))
            set_frame_menubar (f, 0, 0);
          else
            /* On a terminal screen, the menu bar is an ordinary screen
               line, and this makes it get updated.  */
            w->update_mode_line = Qt;
#else /* ! (USE_X_TOOLKIT || HAVE_NTGUI) */
          /* In the non-toolkit version, the menu bar is an ordinary screen
             line, and this makes it get updated.  */
          w->update_mode_line = Qt;
#endif /* ! (USE_X_TOOLKIT || HAVE_NTGUI) */

          unbind_to (count, Qnil);
          set_buffer_internal_1 (prev);
        }
    }
}


\f
/***********************************************************************
                               Toolbars
 ***********************************************************************/

#ifdef HAVE_WINDOW_SYSTEM

/* Update the toolbar item list for frame F.  This has to be done
   before we start to fill in any display lines.  Called from
   prepare_menu_bars.  If SAVE_MATCH_DATA is non-zero, we must save
   and restore it here.  */

static void
update_toolbar (f, save_match_data)
     struct frame *f;
     int save_match_data;
{
  if (WINDOWP (f->toolbar_window)
      && XFASTINT (XWINDOW (f->toolbar_window)->height) > 0)
    {
      Lisp_Object window;
      struct window *w;

      window = FRAME_SELECTED_WINDOW (f);
      w = XWINDOW (window);
  
      /* If the user has switched buffers or windows, we need to
         recompute to reflect the new bindings.  But we'll
         recompute when update_mode_lines is set too; that means
         that people can use force-mode-line-update to request
         that the menu bar be recomputed.  The adverse effect on
         the rest of the redisplay algorithm is about the same as
         windows_or_buffers_changed anyway.  */
      if (windows_or_buffers_changed
          || !NILP (w->update_mode_line)
          || ((BUF_SAVE_MODIFF (XBUFFER (w->buffer))
               < BUF_MODIFF (XBUFFER (w->buffer)))
              != !NILP (w->last_had_star))
          || ((!NILP (Vtransient_mark_mode)
               && !NILP (XBUFFER (w->buffer)->mark_active))
              != !NILP (w->region_showing)))
        {
          struct buffer *prev = current_buffer;
          int count = specpdl_ptr - specpdl;

          /* Set current_buffer to the buffer of the selected
             window of the frame, so that we get the right local
             keymaps.  */
          set_buffer_internal_1 (XBUFFER (w->buffer));

          /* Save match data, if we must.  */
          if (save_match_data)
            record_unwind_protect (Fset_match_data, Fmatch_data (Qnil, Qnil));

          /* Make sure that we don't accidentally use bogus keymaps.  */
          if (NILP (Voverriding_local_map_menu_flag))
            {
              specbind (Qoverriding_terminal_local_map, Qnil);
              specbind (Qoverriding_local_map, Qnil);
            }

          /* Build desired toolbar items from keymaps.  */
          f->desired_toolbar_items
            = toolbar_items (f->desired_toolbar_items,
                             &f->n_desired_toolbar_items);
          
          /* Redisplay the toolbar in case we changed it.  */
          w->update_mode_line = Qt;

          unbind_to (count, Qnil);
          set_buffer_internal_1 (prev);
        }
    }
}


/* Set F->desired_toolbar_string to a Lisp string representing frame
   F's desired toolbar contents.  F->desired_toolbar_items must have
   been set up previously by calling prepare_menu_bars.  */

static void
build_desired_toolbar_string (f)
     struct frame *f;
{
  int i, size, size_needed, string_idx;
  struct gcpro gcpro1, gcpro2, gcpro3;
  Lisp_Object image, plist, props;

  image = plist = props = Qnil;
  GCPRO3 (image, plist, props);

  /* Prepare F->desired_toolbar_string.  If we can reuse it, do so.
     Otherwise, make a new string.  */
  
  /* The size of the string we might be able to reuse.  */
  size = (STRINGP (f->desired_toolbar_string)
          ? XSTRING (f->desired_toolbar_string)->size
          : 0);

  /* Each image in the string we build is preceded by a space,
     and there is a space at the end.  */
  size_needed = f->n_desired_toolbar_items + 1;

  /* Reuse f->desired_toolbar_string, if possible.  */
  if (size < size_needed)
    f->desired_toolbar_string = Fmake_string (make_number (size_needed), ' ');
  else
    {
      props = list4 (Qdisplay, Qnil, Qmenu_item, Qnil);
      Fremove_text_properties (make_number (0), make_number (size),
                               props, f->desired_toolbar_string);
    }

  /* Put a `display' property on the string for the images to display,
     put a `menu_item' property on toolbar items with a value that
     is the index of the item in F's toolbar item vector.  */
  for (i = 0, string_idx = 0;
       i < f->n_desired_toolbar_items;
       ++i, string_idx += 1)
    {
#define PROP(IDX)                                       \
      (XVECTOR (f->desired_toolbar_items)               \
       ->contents[i * TOOLBAR_ITEM_NSLOTS + (IDX)])

      int enabled_p = !NILP (PROP (TOOLBAR_ITEM_ENABLED_P));
      int selected_p = !NILP (PROP (TOOLBAR_ITEM_SELECTED_P));
      int margin, relief;
      extern Lisp_Object QCrelief, QCmargin, QCalgorithm, Qimage;
      extern Lisp_Object Qlaplace;

      /* If image is a vector, choose the image according to the
         button state.  */
      image = PROP (TOOLBAR_ITEM_IMAGES);
      if (VECTORP (image))
        {
          enum toolbar_item_image idx;
          
          if (enabled_p)
            idx = (selected_p
                   ? TOOLBAR_IMAGE_ENABLED_SELECTED
                   : TOOLBAR_IMAGE_ENABLED_DESELECTED);
          else
            idx = (selected_p
                   ? TOOLBAR_IMAGE_DISABLED_SELECTED
                   : TOOLBAR_IMAGE_DISABLED_DESELECTED);
          
          xassert (XVECTOR (image)->size >= idx);
          image = XVECTOR (image)->contents[idx];
        }

      /* Ignore invalid image specifications.  */
      if (!valid_image_p (image))
        continue;

      /* Display the toolbar button pressed, or depressed.  */
      plist = Fcopy_sequence (XCDR (image));

      /* Compute margin and relief to draw.  */
      relief = toolbar_button_relief > 0 ? toolbar_button_relief : 3;
      margin = relief + max (0, toolbar_button_margin);
      
      if (auto_raise_toolbar_buttons_p)
        {
          /* Add a `:relief' property to the image spec if the item is
             selected.  */
          if (selected_p)
            {
              plist = Fplist_put (plist, QCrelief, make_number (-relief));
              margin -= relief;
            }
        }
      else
        {
          /* If image is selected, display it pressed, i.e. with a
             negative relief.  If it's not selected, display it with a
             raised relief.  */
          plist = Fplist_put (plist, QCrelief,
                              (selected_p
                               ? make_number (-relief)
                               : make_number (relief)));
          margin -= relief;
        }

      /* Put a margin around the image.  */
      if (margin)
        plist = Fplist_put (plist, QCmargin, make_number (margin));
          
      /* If button is not enabled, make the image appear disabled by
         applying an appropriate algorithm to it.  */
      if (!enabled_p)
        plist = Fplist_put (plist, QCalgorithm, Qlaplace);
      
      /* Put a `display' text property on the string for the image to
         display.  Put a `menu-item' property on the string that gives
         the start of this item's properties in the toolbar items
         vector.  */
      image = Fcons (Qimage, plist);
      props = list4 (Qdisplay, image,
                     Qmenu_item, make_number (i * TOOLBAR_ITEM_NSLOTS)),
      Fadd_text_properties (make_number (string_idx),
                            make_number (string_idx + 1),
                            props, f->desired_toolbar_string);
#undef PROP
    }

  UNGCPRO;
}


/* Display one line of the toolbar of frame IT->f.  */

static void
display_toolbar_line (it)
     struct it *it;
{
  struct glyph_row *row = it->glyph_row;
  int max_x = it->last_visible_x;
  struct glyph *last;
  
  prepare_desired_row (row);
  row->y = it->current_y;
  
  while (it->current_x < max_x)
    {
      int x_before, x, n_glyphs_before, i, nglyphs;

      /* Get the next display element.  */
      if (!get_next_display_element (it))
        break;

      /* Produce glyphs.  */
      x_before = it->current_x;
      n_glyphs_before = it->glyph_row->used[TEXT_AREA];
      PRODUCE_GLYPHS (it);

      nglyphs = it->glyph_row->used[TEXT_AREA] - n_glyphs_before;
      i = 0;
      x = x_before;
      while (i < nglyphs)
        {
          struct glyph *glyph = row->glyphs[TEXT_AREA] + n_glyphs_before + i;
          
          if (x + glyph->pixel_width > max_x)
            {
              /* Glyph doesn't fit on line.  */
              it->glyph_row->used[TEXT_AREA] = n_glyphs_before + i;
              it->current_x = x;
              goto out;
            }

          ++it->hpos;
          x += glyph->pixel_width;
          ++i;
        }

      /* Stop at line ends.  */
      if (ITERATOR_AT_END_OF_LINE_P (it))
        break;

      set_iterator_to_next (it);
    }

 out:;

  row->displays_text_p = row->used[TEXT_AREA] != 0;
  extend_face_to_end_of_line (it);
  last = row->glyphs[TEXT_AREA] + row->used[TEXT_AREA] - 1;
  last->right_box_line_p = 1;
  compute_line_metrics (it);
  
  /* If line is empty, make it occupy the rest of the toolbar.  */
  if (!row->displays_text_p)
    {
      row->height = it->last_visible_y - row->y;
      row->ascent = 0;
    }
  
  row->full_width_p = 1;
  row->continued_p = 0;
  row->truncated_on_left_p = 0;
  row->truncated_on_right_p = 0;

  it->current_x = it->hpos = 0;
  it->current_y += row->height;
  ++it->vpos;
  ++it->glyph_row;
}


/* Value is the number of screen lines needed to make all toolbar
   items of frame F visible.  */

static int
toolbar_lines_needed (f)
     struct frame *f;
{
  struct window *w = XWINDOW (f->toolbar_window);
  struct it it;
  
  /* Initialize an iterator for iteration over F->desired_toolbar_string
     in the toolbar window of frame F.  */
  init_iterator (&it, w, -1, -1, w->desired_matrix->rows, TOOLBAR_FACE_ID);
  it.first_visible_x = 0;
  it.last_visible_x = FRAME_WINDOW_WIDTH (f) * CANON_X_UNIT (f);
  reseat_to_string (&it, NULL, f->desired_toolbar_string, 0, 0, 0, -1);

  while (!ITERATOR_AT_END_P (&it))
    {
      it.glyph_row = w->desired_matrix->rows;
      clear_glyph_row (it.glyph_row);
      display_toolbar_line (&it);
    }

  return (it.current_y + CANON_Y_UNIT (f) - 1) / CANON_Y_UNIT (f);
}


/* Display the toolbar of frame F.  Value is non-zero if toolbar's
   height should be changed.  */

static int
redisplay_toolbar (f)
     struct frame *f;
{
  struct window *w;
  struct it it;
  struct glyph_row *row;
  int change_height_p = 0;
  
  /* If frame hasn't a toolbar window or if it is zero-height, don't
     do anything.  This means you must start with toolbar-lines
     non-zero to get the auto-sizing effect.  Or in other words, you
     can turn off toolbars by specifying toolbar-lines zero.  */
  if (!WINDOWP (f->toolbar_window)
      || (w = XWINDOW (f->toolbar_window),
          XFASTINT (w->height) == 0))
    return 0;

  /* Set up an iterator for the toolbar window.  */
  init_iterator (&it, w, -1, -1, w->desired_matrix->rows, TOOLBAR_FACE_ID);
  it.first_visible_x = 0;
  it.last_visible_x = FRAME_WINDOW_WIDTH (f) * CANON_X_UNIT (f);
  row = it.glyph_row;

  /* Build a string that represents the contents of the toolbar.  */
  build_desired_toolbar_string (f);
  reseat_to_string (&it, NULL, f->desired_toolbar_string, 0, 0, 0, -1);

  /* Display as many lines as needed to display all toolbar items.  */
  while (it.current_y < it.last_visible_y)
    display_toolbar_line (&it);

  /* It doesn't make much sense to try scrolling in the toolbar
     window, so don't do it.  */
  w->desired_matrix->no_scrolling_p = 1;
  w->must_be_updated_p = 1;

  if (auto_resize_toolbars_p)
    {
      int nlines;
      
      /* If there are blank lines at the end, except for a partially
         visible blank line at the end that is smaller than
         CANON_Y_UNIT, change the toolbar's height.  */
      row = it.glyph_row - 1;
      if (!row->displays_text_p
          && row->height >= CANON_Y_UNIT (f))
        change_height_p = 1;

      /* If row displays toolbar items, but is partially visible,
         change the toolbar's height.  */
      if (row->displays_text_p
          && MATRIX_ROW_BOTTOM_Y (row) > it.last_visible_y)
        change_height_p = 1;

      /* Resize windows as needed by changing the `toolbar-lines'
         frame parameter.  */
      if (change_height_p
          && (nlines = toolbar_lines_needed (f),
              nlines != XFASTINT (w->height)))
        {
          extern Lisp_Object Qtoolbar_lines;
          Lisp_Object frame;
          
          XSETFRAME (frame, f);
          clear_glyph_matrix (w->desired_matrix);
          Fmodify_frame_parameters (frame,
                                    Fcons (Fcons (Qtoolbar_lines,
                                                  make_number (nlines)),
                                           Qnil));
          fonts_changed_p = 1;
        }
    }

  return change_height_p;
}


/* Get information about the toolbar item which is displayed in GLYPH
   on frame F.  Return in *PROP_IDX the index where toolbar item
   properties start in F->current_toolbar_items.  Value is zero if
   GLYPH doesn't display a toolbar item.  */

int
toolbar_item_info (f, glyph, prop_idx)
     struct frame *f;
     struct glyph *glyph;
     int *prop_idx;
{
  Lisp_Object prop;
  int success_p;
  
  /* Get the text property `menu-item' at pos. The value of that
     property is the start index of this item's properties in
     F->current_toolbar_items.  */
  prop = Fget_text_property (make_number (glyph->charpos),
                             Qmenu_item, f->current_toolbar_string);
  if (INTEGERP (prop))
    {
      *prop_idx = XINT (prop);
      success_p = 1;
    }
  else
    success_p = 0;

  return success_p;
}
  
#endif /* HAVE_WINDOW_SYSTEM */


\f
/************************************************************************
                         Horizontal scrolling
 ************************************************************************/

static int hscroll_window_tree P_ ((Lisp_Object));
static int hscroll_windows P_ ((Lisp_Object));

/* For all leaf windows in the window tree rooted at WINDOW, set their
   hscroll value so that PT is (i) visible in the window, and (ii) so
   that it is not within a certain margin at the window's left and
   right border.  Value is non-zero if any window's hscroll has been
   changed.  */

static int
hscroll_window_tree (window)
     Lisp_Object window;
{
  int hscrolled_p = 0;
  
  while (WINDOWP (window))
    {
      struct window *w = XWINDOW (window);
      
      if (WINDOWP (w->hchild))
        hscrolled_p |= hscroll_window_tree (w->hchild);
      else if (WINDOWP (w->vchild))
        hscrolled_p |= hscroll_window_tree (w->vchild);
      else if (w->cursor.vpos >= 0)
        {
          int hscroll_margin, text_area_x, text_area_y;
          int text_area_width, text_area_height;
          struct glyph_row *cursor_row = MATRIX_ROW (w->current_matrix,
                                                     w->cursor.vpos);

          window_box (w, TEXT_AREA, &text_area_x, &text_area_y,
                      &text_area_width, &text_area_height);

          /* Scroll when cursor is inside this scroll margin.  */
          hscroll_margin = 5 * CANON_X_UNIT (XFRAME (w->frame));
          
          if ((XFASTINT (w->hscroll)
               && w->cursor.x < hscroll_margin)
              || (cursor_row->truncated_on_right_p
                  && (w->cursor.x > text_area_width - hscroll_margin)))
            {
              struct it it;
              int hscroll;
              struct buffer *saved_current_buffer;
              int pt;

              /* Find point in a display of infinite width.  */
              saved_current_buffer = current_buffer;
              current_buffer = XBUFFER (w->buffer);
              
              if (w == XWINDOW (selected_window))
                pt = BUF_PT (current_buffer);
              else
                {
                  pt = marker_position (w->pointm);
                  pt = max (BEGV, pt);
                  pt = min (ZV, pt);
                }

              /* Move iterator to pt starting at cursor_row->start in
                 a line with infinite width.  */
              init_to_row_start (&it, w, cursor_row);
              it.last_visible_x = INFINITY;
              move_it_in_display_line_to (&it, pt, -1, MOVE_TO_POS);
              current_buffer = saved_current_buffer;

              /* Center cursor in window.  */
              hscroll = (max (0, it.current_x - text_area_width / 2)
                         / CANON_X_UNIT (it.f));

              /* Don't call Fset_window_hscroll if value hasn't
                 changed because it will prevent redisplay
                 optimizations.  */
              if (XFASTINT (w->hscroll) != hscroll)
                {
                  Fset_window_hscroll (window, make_number (hscroll));
                  hscrolled_p = 1;
                }
            }
        }

      window = w->next;
    }

  /* Value is non-zero if hscroll of any leaf window has been changed.  */
  return hscrolled_p;
}


/* Set hscroll so that cursor is visible and not inside horizontal
   scroll margins for all windows in the tree rooted at WINDOW.  See
   also hscroll_window_tree above.  Value is non-zero if any window's
   hscroll has been changed.  If it has, desired matrices on the frame
   of WINDOW are cleared.  */

static int
hscroll_windows (window)
     Lisp_Object window;
{
  int hscrolled_p = hscroll_window_tree (window);
  if (hscrolled_p)
    clear_desired_matrices (XFRAME (WINDOW_FRAME (XWINDOW (window))));
  return hscrolled_p;
}


\f
/************************************************************************
                                Redisplay
 ************************************************************************/

/* Variables holding some state of redisplay if GLYPH_DEBUG is defined
   to a non-zero value.  This is sometimes handy to have in a debugger
   session.  */

#if GLYPH_DEBUG

/* Values of beg_unchanged and end_unchanged as of last call to
   try_window_id.  */

int debug_beg_unchanged, debug_end_unchanged;

/* First and last unchanged row for try_window_id.  */

int debug_first_unchanged_at_end_vpos;
int debug_last_unchanged_at_beg_vpos;

/* Delta vpos and y.  */

int debug_dvpos, debug_dy;

/* Delta in characters and bytes for try_window_id.  */

int debug_delta, debug_delta_bytes;

/* Values of window_end_pos and window_end_vpos at the end of
   try_window_id.  */

int debug_end_pos, debug_end_vpos;

/* Append a string to W->desired_matrix->method.  FMT is a printf
   format string.  A1...A9 are a supplement for a variable-length
   argument list.  If trace_redisplay_p is non-zero also printf the
   resulting string to stderr.  */

static void
debug_method_add (w, fmt, a1, a2, a3, a4, a5, a6, a7, a8, a9)
     struct window *w;
     char *fmt;
     int a1, a2, a3, a4, a5, a6, a7, a8, a9;
{
  char buffer[512];
  char *method = w->desired_matrix->method;
  int len = strlen (method);
  int size = sizeof w->desired_matrix->method;
  int remaining = size - len - 1;

  sprintf (buffer, fmt, a1, a2, a3, a4, a5, a6, a7, a8, a9);
  if (len && remaining)
    {
      method[len] = '|';
      --remaining, ++len;
    }
  
  strncpy (method + len, buffer, remaining);

  if (trace_redisplay_p)
    fprintf (stderr, "%p (%s): %s\n",
             w,
             ((BUFFERP (w->buffer)
               && STRINGP (XBUFFER (w->buffer)->name))
              ? (char *) XSTRING (XBUFFER (w->buffer)->name)->data
              : "no buffer"),
             buffer);
}

#endif /* GLYPH_DEBUG */


/* This counter is used to clear the face cache every once in a while
   in redisplay_internal.  It is incremented for each redisplay.
   Every CLEAR_FACE_CACHE_COUNT full redisplays, the face cache is
   cleared.  */

#define CLEAR_FACE_CACHE_COUNT  10000
static int clear_face_cache_count;

/* Record the previous terminal frame we displayed.  */

static struct frame *previous_terminal_frame;

/* Non-zero while redisplay_internal is in progress.  */

int redisplaying_p;


/* Value is non-zero if all changes in window W, which displays
   current_buffer, are in the text between START and END.  START is a
   buffer position, END is given as a distance from Z.  Used in
   redisplay_internal for display optimization.  */

static INLINE int
text_outside_line_unchanged_p (w, start, end)
     struct window *w;
     int start, end;
{
  int unchanged_p = 1;
  
  /* If text or overlays have changed, see where.  */
  if (XFASTINT (w->last_modified) < MODIFF
      || XFASTINT (w->last_overlay_modified) < OVERLAY_MODIFF)
    {
      /* Gap in the line?  */
      if (GPT < start || Z - GPT < end)
        unchanged_p = 0;

      /* Changes start in front of the line, or end after it?  */
      if (unchanged_p
          && (beg_unchanged < start - 1
              || end_unchanged < end))
        unchanged_p = 0;
      
      /* If selective display, can't optimize if changes start at the
         beginning of the line.  */
      if (unchanged_p
          && INTEGERP (current_buffer->selective_display)
          && XINT (current_buffer->selective_display) > 0
          && (beg_unchanged < start || GPT <= start))
        unchanged_p = 0;
    }

  return unchanged_p;
}


/* Do a frame update, taking possible shortcuts into account.  This is
   the main external entry point for redisplay.

   If the last redisplay displayed an echo area message and that message
   is no longer requested, we clear the echo area or bring back the
   mini-buffer if that is in use.  */

void
redisplay ()
{
  redisplay_internal (0);
}


/* If PRESERVE_ECHO_AREA is nonzero, it means this redisplay is not in
   response to any user action; therefore, we should preserve the echo
   area.  (Actually, our caller does that job.)  Perhaps in the future
   avoid recentering windows if it is not necessary; currently that
   causes some problems.  */

static void
redisplay_internal (preserve_echo_area)
     int preserve_echo_area;
{
  struct window *w = XWINDOW (selected_window);
  struct frame *f = XFRAME (w->frame);
  int pause;
  int must_finish = 0;
  struct text_pos tlbufpos, tlendpos;
  int number_of_visible_frames;

  /* Non-zero means redisplay has to consider all windows on all
     frames.  Zero means, only selected_window is considered.  */
  int consider_all_windows_p;
  
  TRACE ((stderr, "redisplay_internal %d\n", redisplaying_p));

  /* No redisplay if running in batch mode or frame is not yet fully
     initialized, or redisplay is explicitly turned off by setting
     Vinhibit_redisplay.  */
  if (noninteractive
      || !NILP (Vinhibit_redisplay)
      || !f->glyphs_initialized_p)
    return;

  /* The flag redisplay_performed_directly_p is set by
     direct_output_for_insert when it already did the whole screen
     update necessary.  */
  if (redisplay_performed_directly_p)
    {
      redisplay_performed_directly_p = 0;
      if (!hscroll_windows (selected_window))
        return;
    }

#ifdef USE_X_TOOLKIT
  if (popup_activated ())
    return;
#endif

  if (redisplaying_p)
    return;
  ++redisplaying_p;

 retry:

  /* If new fonts have been loaded that make a glyph matrix adjustment
     necessary, do it.  */
  if (fonts_changed_p)
    {
      adjust_glyphs (NULL);
      ++windows_or_buffers_changed;
      fonts_changed_p = 0;
    }

  if (! FRAME_WINDOW_P (selected_frame)
      && previous_terminal_frame != selected_frame)
    {
      /* Since frames on an ASCII terminal share the same display
         area, displaying a different frame means redisplay the whole
         thing.  */
      windows_or_buffers_changed++;
      SET_FRAME_GARBAGED (selected_frame);
      XSETFRAME (Vterminal_frame, selected_frame);
    }
  previous_terminal_frame = selected_frame;

  /* Set the visible flags for all frames.  Do this before checking
     for resized or garbaged frames; they want to know if their frames
     are visible.  See the comment in frame.h for
     FRAME_SAMPLE_VISIBILITY.  */
  {
    Lisp_Object tail, frame;

    number_of_visible_frames = 0;

    FOR_EACH_FRAME (tail, frame)
      {
        struct frame *f = XFRAME (frame);
        
        FRAME_SAMPLE_VISIBILITY (f);
        if (FRAME_VISIBLE_P (f))
          ++number_of_visible_frames;
        clear_desired_matrices (f);
      }
  }

  /* Notice any pending interrupt request to change frame size.  */
  do_pending_window_change ();

  /* Clear frames marked as garbaged.  */
  if (frame_garbaged)
    {
      /* Old redisplay called redraw_garbaged_frames here which in
         turn called redraw_frame which in turn called clear_frame.
         The call to clear_frame is a source of flickering.  After
         checking the places where SET_FRAME_GARBAGED is called, I
         believe a clear_frame is not necessary.  It should suffice in
         the new redisplay to invalidate all current matrices, and
         ensure a complete redisplay of all windows.  */
      Lisp_Object tail, frame;
      
      FOR_EACH_FRAME (tail, frame)
        {
          struct frame *f = XFRAME (frame);
          
          if (FRAME_VISIBLE_P (f) && FRAME_GARBAGED_P (f))
            {
              clear_current_matrices (f);
              f->garbaged = 0;
            }
        }

      frame_garbaged = 0;
      ++windows_or_buffers_changed;
    }

  /* Build menubar and toolbar items.  */
  prepare_menu_bars ();

  if (windows_or_buffers_changed)
    update_mode_lines++;

  /* Detect case that we need to write or remove a star in the mode line.  */
  if ((SAVE_MODIFF < MODIFF) != !NILP (w->last_had_star))
    {
      w->update_mode_line = Qt;
      if (buffer_shared > 1)
        update_mode_lines++;
    }

  /* If %c is in the mode line, update it if needed.  */
  if (!NILP (w->column_number_displayed)
      /* This alternative quickly identifies a common case
         where no change is needed.  */
      && !(PT == XFASTINT (w->last_point)
           && XFASTINT (w->last_modified) >= MODIFF
           && XFASTINT (w->last_overlay_modified) >= OVERLAY_MODIFF)
      && XFASTINT (w->column_number_displayed) != current_column ())
    w->update_mode_line = Qt; 

  FRAME_SCROLL_BOTTOM_VPOS (XFRAME (w->frame)) = -1;

  /* The variable buffer_shared is set in redisplay_window and
     indicates that we redisplay a buffer in different windows.  See
     there.  */
  consider_all_windows_p = update_mode_lines || buffer_shared > 1;

  /* If specs for an arrow have changed, do thorough redisplay
     to ensure we remove any arrow that should no longer exist.  */
  if (! EQ (COERCE_MARKER (Voverlay_arrow_position), last_arrow_position)
      || ! EQ (Voverlay_arrow_string, last_arrow_string))
    consider_all_windows_p = windows_or_buffers_changed = 1;

  /* Normally the message* functions will have already displayed and
     updated the echo area, but the frame may have been trashed, or
     the update may have been preempted, so display the echo area
     again here.  */
  if (echo_area_glyphs
      || STRINGP (echo_area_message)
      || previous_echo_glyphs
      || STRINGP (previous_echo_area_message))
    {
      echo_area_display (0);
      must_finish = 1;
    }

  /* If showing the region, and mark has changed, we must redisplay
     the whole window.  The assignment to this_line_start_pos prevents
     the optimization directly below this if-statement.  */
  if (((!NILP (Vtransient_mark_mode)
        && !NILP (XBUFFER (w->buffer)->mark_active))
       != !NILP (w->region_showing))
      || (!NILP (w->region_showing)
          && !EQ (w->region_showing,
                  Fmarker_position (XBUFFER (w->buffer)->mark))))
    CHARPOS (this_line_start_pos) = 0;

  /* Optimize the case that only the line containing the cursor in the
     selected window has changed.  Variables starting with this_ are
     set in display_line and record information about the line
     containing the cursor.  */
  tlbufpos = this_line_start_pos;
  tlendpos = this_line_end_pos;
  if (!consider_all_windows_p
      && CHARPOS (tlbufpos) > 0
      && NILP (w->update_mode_line)
      && !current_buffer->clip_changed
      && FRAME_VISIBLE_P (XFRAME (w->frame))
      && !FRAME_OBSCURED_P (XFRAME (w->frame))
      /* Make sure recorded data applies to current buffer, etc.  */
      && this_line_buffer == current_buffer
      && current_buffer == XBUFFER (w->buffer)
      && NILP (w->force_start)
      /* Point must be on the line that we have info recorded about.  */
      && PT >= CHARPOS (tlbufpos)
      && PT <= Z - CHARPOS (tlendpos)
      /* All text outside that line, including its final newline,
         must be unchanged */
      && text_outside_line_unchanged_p (w, CHARPOS (tlbufpos),
                                        CHARPOS (tlendpos)))
    {
      if (CHARPOS (tlbufpos) > BEGV
          && FETCH_BYTE (BYTEPOS (tlbufpos) - 1) != '\n'
          && (CHARPOS (tlbufpos) == ZV
              || FETCH_BYTE (BYTEPOS (tlbufpos)) == '\n'))
        /* Former continuation line has disappeared by becoming empty */
        goto cancel;
      else if (XFASTINT (w->last_modified) < MODIFF
               || XFASTINT (w->last_overlay_modified) < OVERLAY_MODIFF
               || MINI_WINDOW_P (w))
        {
          /* We have to handle the case of continuation around a
             wide-column character (See the comment in indent.c around
             line 885).

             For instance, in the following case:

             --------  Insert  --------
             K_A_N_\\   `a'    K_A_N_a\         `X_' are wide-column chars.
             J_I_       ==>    J_I_             `^^' are cursors.
             ^^                ^^
             --------          --------

             As we have to redraw the line above, we should goto cancel.  */

          struct it it;
          int line_height_before = this_line_pixel_height;

          /* Note that start_display will handle the case that the
             line starting at tlbufpos is a continuation lines.  */
          start_display (&it, w, tlbufpos);

          /* Implementation note: It this still necessary?  */
          if (it.current_x != this_line_start_x)
            goto cancel;

          TRACE ((stderr, "trying display optimization 1\n"));
          w->cursor.vpos = -1;
          overlay_arrow_seen = 0;
          it.vpos = this_line_vpos;
          it.current_y = this_line_y;
          it.glyph_row = MATRIX_ROW (w->desired_matrix, this_line_vpos);
          display_line (&it);

          /* If line contains point, is not continued,
             and ends at same distance from eob as before, we win */
          if (w->cursor.vpos >= 0 
              /* Line is not continued, otherwise this_line_start_pos
                 would have been set to 0 in display_line.  */
              && CHARPOS (this_line_start_pos)
              /* Line ends as before.  */
              && CHARPOS (this_line_end_pos) == CHARPOS (tlendpos)
              /* Line has same height as before.  Otherwise other lines
                 would have to be shifted up or down.  */
              && this_line_pixel_height == line_height_before)
            {
              /* If this is not the window's last line, we must adjust
                 the charstarts of the lines below.  */
              if (it.current_y < it.last_visible_y)
                {
                  struct glyph_row *row
                    = MATRIX_ROW (w->current_matrix, this_line_vpos + 1);
                  int delta, delta_bytes;
  
                  if (Z - CHARPOS (tlendpos) == ZV)
                    {
                      /* This line ends at end of (accessible part of)
                         buffer.  There is no newline to count.  */
                      delta = (Z
                               - CHARPOS (tlendpos)
                               - MATRIX_ROW_START_CHARPOS (row));
                      delta_bytes = (Z_BYTE
                                     - BYTEPOS (tlendpos)
                                     - MATRIX_ROW_START_BYTEPOS (row));
                    }
                  else
                    {
                      /* This line ends in a newline.  Must take
                         account of the newline and the rest of the
                         text that follows.  */
                      delta = (Z
                               - CHARPOS (tlendpos)
                               - MATRIX_ROW_START_CHARPOS (row));
                      delta_bytes = (Z_BYTE
                                     - BYTEPOS (tlendpos)
                                     - MATRIX_ROW_START_BYTEPOS (row));
                    }
  
                  increment_glyph_matrix_buffer_positions (w->current_matrix,
                                                           this_line_vpos + 1,
                                                           w->current_matrix->nrows,
                                                           delta, delta_bytes);
                }

              /* If this row displays text now but previously didn't,
                 or vice versa, w->window_end_vpos may have to be
                 adjusted.  */
              if ((it.glyph_row - 1)->displays_text_p)
                {
                  if (XFASTINT (w->window_end_vpos) < this_line_vpos)
                    XSETINT (w->window_end_vpos, this_line_vpos);
                }
              else if (XFASTINT (w->window_end_vpos) == this_line_vpos
                       && this_line_vpos > 0)
                XSETINT (w->window_end_vpos, this_line_vpos - 1);
              w->window_end_valid = Qnil;
              
              /* Update hint: No need to try to scroll in update_window.  */
              w->desired_matrix->no_scrolling_p = 1;

#if GLYPH_DEBUG
              *w->desired_matrix->method = 0;
              debug_method_add (w, "optimization 1");
#endif
              goto update;
            }
          else
            goto cancel;
        }
      else if (/* Cursor position hasn't changed.  */
               PT == XFASTINT (w->last_point)
               /* Make sure the cursor was last displayed
                  in this window.  Otherwise we have to reposition it.  */
               && 0 <= w->cursor.vpos
               && XINT (w->height) > w->cursor.vpos)
        {
          if (!must_finish)
            {
              do_pending_window_change ();

              /* We used to always goto end_of_redisplay here, but this 
                 isn't enough if we have a blinking cursor.  */
              if (w->cursor_off_p == w->last_cursor_off_p)
                goto end_of_redisplay;
            }
          goto update;
        }
      /* If highlighting the region, or if the cursor is in the echo area,
         then we can't just move the cursor.  */
      else if (! (!NILP (Vtransient_mark_mode)
                  && !NILP (current_buffer->mark_active))
               && (w == XWINDOW (current_buffer->last_selected_window)
                   || highlight_nonselected_windows)
               && NILP (w->region_showing)
               && !cursor_in_echo_area)
        {
          struct it it;
          struct glyph_row *row;

          /* Skip from tlbufpos to PT and see where it is.  Note that
             PT may be in invisible text.  If so, we will end at the
             next visible position.  */
          init_iterator (&it, w, CHARPOS (tlbufpos), BYTEPOS (tlbufpos),
                         NULL, DEFAULT_FACE_ID);
          it.current_x = this_line_start_x;
          it.current_y = this_line_y;
          it.vpos = this_line_vpos;
          
          /* The call to move_it_to stops in front of PT, but
             moves over before-strings.  */
          move_it_to (&it, PT, -1, -1, -1, MOVE_TO_POS);

          if (it.vpos == this_line_vpos
              && (row = MATRIX_ROW (w->current_matrix, this_line_vpos),
                  row->enabled_p))
            {
              xassert (this_line_vpos == it.vpos);
              xassert (this_line_y == it.current_y);
              set_cursor_from_row (w, row, w->current_matrix, 0, 0, 0, 0);
              goto update;
            }
          else
            goto cancel;
        }

    cancel:
      /* Text changed drastically or point moved off of line.  */
      SET_MATRIX_ROW_ENABLED_P (w->desired_matrix, this_line_vpos, 0);
    }

  CHARPOS (this_line_start_pos) = 0;
  consider_all_windows_p |= buffer_shared > 1;
  ++clear_face_cache_count;

  
  /* Build desired matrices.  If consider_all_windows_p is non-zero,
     do it for all windows on all frames.  Otherwise do it for
     selected_window, only.  */

  if (consider_all_windows_p)
    {
      Lisp_Object tail, frame;

      /* Clear the face cache eventually.  */
      if (clear_face_cache_count > CLEAR_FACE_CACHE_COUNT)
        {
          clear_face_cache (0);
          clear_face_cache_count = 0;
        }

      /* Recompute # windows showing selected buffer.  This will be
         incremented each time such a window is displayed.  */
      buffer_shared = 0;

      FOR_EACH_FRAME (tail, frame)
        {
          struct frame *f = XFRAME (frame);
          if (FRAME_WINDOW_P (f) || f == selected_frame)
            {
              /* Mark all the scroll bars to be removed; we'll redeem
                 the ones we want when we redisplay their windows.  */
              if (condemn_scroll_bars_hook)
                (*condemn_scroll_bars_hook) (f);

              if (FRAME_VISIBLE_P (f) && !FRAME_OBSCURED_P (f))
                redisplay_windows (FRAME_ROOT_WINDOW (f));

              /* Any scroll bars which redisplay_windows should have
                 nuked should now go away.  */
              if (judge_scroll_bars_hook)
                (*judge_scroll_bars_hook) (f);
            }
        }
    }
  else if (FRAME_VISIBLE_P (selected_frame)
           && !FRAME_OBSCURED_P (selected_frame))
    redisplay_window (selected_window, 1);

  
  /* Compare desired and current matrices, perform output.  */
  
update:
  
  /* If fonts changed, display again.  */
  if (fonts_changed_p)
    goto retry;

  /* Prevent various kinds of signals during display update.
     stdio is not robust about handling signals,
     which can cause an apparent I/O error.  */
  if (interrupt_input)
    unrequest_sigio ();
  stop_polling ();

  if (consider_all_windows_p)
    {
      Lisp_Object tail;

      pause = 0;

      for (tail = Vframe_list; CONSP (tail); tail = XCONS (tail)->cdr)
        {
          struct frame *f;

          if (!FRAMEP (XCONS (tail)->car))
            continue;

          f = XFRAME (XCONS (tail)->car);

          if ((FRAME_WINDOW_P (f) || f == selected_frame)
              && FRAME_VISIBLE_P (f) && !FRAME_OBSCURED_P (f))
            {
              /* Mark all windows as to be updated.  */
              set_window_update_flags (XWINDOW (f->root_window), 1);
              pause |= update_frame (f, 0, 0);
              if (!pause)
                {
                  if (hscroll_windows (f->root_window))
                    goto retry;

                  mark_window_display_accurate (f->root_window, 1);
                  if (frame_up_to_date_hook != 0)
                    (*frame_up_to_date_hook) (f);
                }
            }
        }
    }
  else
    {
      if (FRAME_VISIBLE_P (selected_frame)
          && !FRAME_OBSCURED_P (selected_frame))
        {
          XWINDOW (selected_window)->must_be_updated_p = 1;
          pause = update_frame (selected_frame, 0, 0);
          if (!pause && hscroll_windows (selected_window))
            goto retry;
        }
      else
        pause = 0;

      /* We may have called echo_area_display at the top of this
         function.  If the echo area is on another frame, that may
         have put text on a frame other than the selected one, so the
         above call to update_frame would not have caught it.  Catch
         it here.  */
      {
        Lisp_Object mini_window;
        struct frame *mini_frame;

        mini_window = FRAME_MINIBUF_WINDOW (selected_frame);
        mini_frame = XFRAME (WINDOW_FRAME (XWINDOW (mini_window)));
        
        if (mini_frame != selected_frame && FRAME_WINDOW_P (mini_frame))
          {
            XWINDOW (mini_window)->must_be_updated_p = 1;
            pause |= update_frame (mini_frame, 0, 0);
            if (!pause && hscroll_windows (mini_window))
              goto retry;
          }
      }
    }

  /* If display was paused because of pending input, make sure we do a
     thorough update the next time.  */
  if (pause)
    {
      /* Prevent the optimization at the beginning of
         redisplay_internal that tries a single-line update of the
         line containing the cursor in the selected window.  */
      CHARPOS (this_line_start_pos) = 0;

      /* Let the overlay arrow be updated the next time.  */
      if (!NILP (last_arrow_position))
        {
          last_arrow_position = Qt;
          last_arrow_string = Qt;
        }
      
      /* If we pause after scrolling, some rows in the current
         matrices of some windows are not valid.  */
      if (!WINDOW_FULL_WIDTH_P (w)
          && !FRAME_WINDOW_P (XFRAME (w->frame)))
        update_mode_lines = 1;
    }

  /* Now text on frame agrees with windows, so put info into the
     windows for partial redisplay to follow.  */
  if (!pause)
    {
      register struct buffer *b = XBUFFER (w->buffer);

      unchanged_modified = BUF_MODIFF (b);
      overlay_unchanged_modified = BUF_OVERLAY_MODIFF (b);
      beg_unchanged = BUF_GPT (b) - BUF_BEG (b);
      end_unchanged = BUF_Z (b) - BUF_GPT (b);

      if (consider_all_windows_p)
        mark_window_display_accurate (FRAME_ROOT_WINDOW (selected_frame), 1);
      else
        {
          XSETFASTINT (w->last_point, BUF_PT (b));
          w->last_cursor = w->cursor;
          w->last_cursor_off_p = w->cursor_off_p;

          b->clip_changed = 0;
          w->update_mode_line = Qnil;
          XSETFASTINT (w->last_modified, BUF_MODIFF (b));
          XSETFASTINT (w->last_overlay_modified, BUF_OVERLAY_MODIFF (b));
          w->last_had_star
            = (BUF_MODIFF (XBUFFER (w->buffer)) > BUF_SAVE_MODIFF (XBUFFER (w->buffer))
               ? Qt : Qnil);

          /* Record if we are showing a region, so can make sure to
             update it fully at next redisplay.  */
          w->region_showing = (!NILP (Vtransient_mark_mode)
                               && (w == XWINDOW (current_buffer->last_selected_window)
                                   || highlight_nonselected_windows)
                               && !NILP (XBUFFER (w->buffer)->mark_active)
                               ? Fmarker_position (XBUFFER (w->buffer)->mark)
                               : Qnil);

          w->window_end_valid = w->buffer;
          last_arrow_position = COERCE_MARKER (Voverlay_arrow_position);
          last_arrow_string = Voverlay_arrow_string;
          if (frame_up_to_date_hook != 0)
            (*frame_up_to_date_hook) (selected_frame);
        }
      
      update_mode_lines = 0;
      windows_or_buffers_changed = 0;
    }

  /* Start SIGIO interrupts coming again.  Having them off during the
     code above makes it less likely one will discard output, but not
     impossible, since there might be stuff in the system buffer here.
     But it is much hairier to try to do anything about that.  */
  if (interrupt_input)
    request_sigio ();
  start_polling ();

  /* If a frame has become visible which was not before, redisplay
     again, so that we display it.  Expose events for such a frame
     (which it gets when becoming visible) don't call the parts of
     redisplay constructing glyphs, so simply exposing a frame won't
     display anything in this case.  So, we have to display these
     frames here explicitly.  */
  if (!pause)
    {
      Lisp_Object tail, frame;
      int new_count = 0;

      FOR_EACH_FRAME (tail, frame)
        {
          int this_is_visible = 0;

          if (XFRAME (frame)->visible)
            this_is_visible = 1;
          FRAME_SAMPLE_VISIBILITY (XFRAME (frame));
          if (XFRAME (frame)->visible)
            this_is_visible = 1;

          if (this_is_visible)
            new_count++;
        }

      if (new_count != number_of_visible_frames)
        windows_or_buffers_changed++;
    }

  /* Change frame size now if a change is pending.  */
  do_pending_window_change ();

  /* If we just did a pending size change, or have additional
     visible frames, redisplay again.  */
  if (windows_or_buffers_changed && !pause)
    goto retry;

 end_of_redisplay:;
  
  if (--redisplaying_p < 0)
    redisplaying_p = 0;
}


/* Redisplay, but leave alone any recent echo area message unless
   another message has been requested in its place.

   This is useful in situations where you need to redisplay but no
   user action has occurred, making it inappropriate for the message
   area to be cleared.  See tracking_off and
   wait_reading_process_input for examples of these situations.  */

void
redisplay_preserve_echo_area ()
{
  if (!echo_area_glyphs
      && !STRINGP (echo_area_message)
      && (previous_echo_glyphs
          || STRINGP (previous_echo_area_message)))
    {
      echo_area_glyphs = previous_echo_glyphs;
      echo_area_message = previous_echo_area_message;
      echo_area_glyphs_length = previous_echo_glyphs_length;
      redisplay_internal (1);
      echo_area_glyphs = NULL;
      echo_area_message = Qnil;
    }
  else
    redisplay_internal (1);
}


/* Mark the display of windows in the window tree rooted at WINDOW as
   accurate or inaccurate.  If FLAG is non-zero mark display of WINDOW
   as accurate.  If FLAG is zero arrange for WINDOW to be redisplayed
   the next time redisplay_internal is called.  */

void
mark_window_display_accurate (window, accurate_p)
     Lisp_Object window;
     int accurate_p;
{
  struct window *w;
  
  for (; !NILP (window); window = w->next)
    {
      w = XWINDOW (window);

      if (BUFFERP (w->buffer))
        {
          struct buffer *b = XBUFFER (w->buffer);
          
          XSETFASTINT (w->last_modified,
                       accurate_p ? BUF_MODIFF (b) : 0);
          XSETFASTINT (w->last_overlay_modified,
                       accurate_p ? BUF_OVERLAY_MODIFF (b) : 0);
          w->last_had_star = (BUF_MODIFF (b) > BUF_SAVE_MODIFF (b)
                              ? Qt : Qnil);

#if 0 /* I don't think this is necessary because display_line does it.
         Let's check it.  */
          /* Record if we are showing a region, so can make sure to
             update it fully at next redisplay.  */
          w->region_showing
            = (!NILP (Vtransient_mark_mode)
               && (w == XWINDOW (current_buffer->last_selected_window)
                   || highlight_nonselected_windows)
               && (!NILP (b->mark_active)
                   ? Fmarker_position (b->mark)
                   : Qnil));
#endif
          
          if (accurate_p)
            {
              b->clip_changed = 0;
              w->last_cursor = w->cursor;
              w->last_cursor_off_p = w->cursor_off_p;
              if (w == XWINDOW (selected_window))
                w->last_point = BUF_PT (b);
              else
                w->last_point = XMARKER (w->pointm)->charpos;
            }
        }

      w->window_end_valid = w->buffer;
      w->update_mode_line = Qnil;

      if (!NILP (w->vchild))
        mark_window_display_accurate (w->vchild, accurate_p);
      if (!NILP (w->hchild))
        mark_window_display_accurate (w->hchild, accurate_p);
    }

  if (accurate_p)
    {
      last_arrow_position = COERCE_MARKER (Voverlay_arrow_position);
      last_arrow_string = Voverlay_arrow_string;
    }
  else
    {
      /* Force a thorough redisplay the next time by setting
         last_arrow_position and last_arrow_string to t, which is
         unequal to any useful value of Voverlay_arrow_... */
      last_arrow_position = Qt;
      last_arrow_string = Qt;
    }
}


/* Return value in display table DP (Lisp_Char_Table *) for character
   C.  Since a display table doesn't have any parent, we don't have to
   follow parent.  Do not call this function directly but use the
   macro DISP_CHAR_VECTOR.  */

Lisp_Object
disp_char_vector (dp, c)
     struct Lisp_Char_Table *dp;
     int c;
{
  int code[4], i;
  Lisp_Object val;

  if (SINGLE_BYTE_CHAR_P (c))
    return (dp->contents[c]);
  
  SPLIT_NON_ASCII_CHAR (c, code[0], code[1], code[2]);
  if (code[0] != CHARSET_COMPOSITION)
    {
      if (code[1] < 32)
        code[1] = -1;
      else if (code[2] < 32)
        code[2] = -1;
    }
  
  /* Here, the possible range of code[0] (== charset ID) is
     128..max_charset.  Since the top level char table contains data
     for multibyte characters after 256th element, we must increment
     code[0] by 128 to get a correct index.  */
  code[0] += 128;
  code[3] = -1;         /* anchor */

  for (i = 0; code[i] >= 0; i++, dp = XCHAR_TABLE (val))
    {
      val = dp->contents[code[i]];
      if (!SUB_CHAR_TABLE_P (val))
        return (NILP (val) ? dp->defalt : val);
    }
  
  /* Here, val is a sub char table.  We return the default value of
     it.  */
  return (dp->defalt);
}


\f
/***********************************************************************
                           Window Redisplay
 ***********************************************************************/

/* Redisplay all leaf windows in the window tree rooted at WINDOW.  */

static void
redisplay_windows (window)
     Lisp_Object window;
{
  while (!NILP (window))
    {
      struct window *w = XWINDOW (window);
      
      if (!NILP (w->hchild))
        redisplay_windows (w->hchild);
      else if (!NILP (w->vchild))
        redisplay_windows (w->vchild);
      else
        redisplay_window (window, 0);

      window = w->next;
    }
}


/* Set cursor position of W.  PT is assumed to be displayed in ROW.
   DELTA is the number of bytes by which positions recorded in ROW
   differ from current buffer positions.  */

void
set_cursor_from_row (w, row, matrix, delta, delta_bytes, dy, dvpos)
     struct window *w;
     struct glyph_row *row;
     struct glyph_matrix *matrix;
     int delta, delta_bytes, dy, dvpos;
{
  struct glyph *glyph = row->glyphs[TEXT_AREA];
  struct glyph *end = glyph + row->used[TEXT_AREA];
  int x = row->x;
  int pt_old = PT - delta;

  /* Skip over glyphs not having an object at the start of the row.
     These are special glyphs like truncation marks on terminal
     frames.  */
  if (row->displays_text_p)
    while (glyph < end
           && !glyph->object
           && glyph->charpos < 0)
      {
        x += glyph->pixel_width;
        ++glyph;
      }

  while (glyph < end
         && glyph->object
         && (!BUFFERP (glyph->object)
             || glyph->charpos < pt_old))
    {
      x += glyph->pixel_width;
      ++glyph;
    }

  w->cursor.hpos = glyph - row->glyphs[TEXT_AREA];
  w->cursor.x = x;
  w->cursor.vpos = MATRIX_ROW_VPOS (row, matrix) + dvpos;
  w->cursor.y = row->y + dy;

  if (w == XWINDOW (selected_window))
    {
      if (!row->continued_p
          && !MATRIX_ROW_CONTINUATION_LINE_P (row)
          && row->x == 0)
        {
          this_line_buffer = XBUFFER (w->buffer);
          
          CHARPOS (this_line_start_pos)
            = MATRIX_ROW_START_CHARPOS (row) + delta;
          BYTEPOS (this_line_start_pos)
            = MATRIX_ROW_START_BYTEPOS (row) + delta_bytes;
          
          CHARPOS (this_line_end_pos)
            = Z - (MATRIX_ROW_END_CHARPOS (row) + delta);
          BYTEPOS (this_line_end_pos)
            = Z_BYTE - (MATRIX_ROW_END_BYTEPOS (row) + delta_bytes);
          
          this_line_y = w->cursor.y;
          this_line_pixel_height = row->height;
          this_line_vpos = w->cursor.vpos;
          this_line_start_x = row->x;
        }
      else
        CHARPOS (this_line_start_pos) = 0;
    }
}


/* Run window scroll functions, if any, for WINDOW with new window
   start STARTP.  Sets the window start of WINDOW to that position.  */

static INLINE struct text_pos
run_window_scroll_functions (window, startp)
     Lisp_Object window;
     struct text_pos startp;
{
  struct window *w = XWINDOW (window);
  SET_MARKER_FROM_TEXT_POS (w->start, startp);
  
  if (!NILP (Vwindow_scroll_functions))
    {
      run_hook_with_args_2 (Qwindow_scroll_functions, window, 
                            make_number (CHARPOS (startp)));
      SET_TEXT_POS_FROM_MARKER (startp, w->start);
    }

  return startp;
}


/* Modify the desired matrix of window W and W->vscroll so that the
   line containing the cursor is fully visible.  */

static void
make_cursor_line_fully_visible (w)
     struct window *w;
{
  struct glyph_matrix *matrix;
  struct glyph_row *row;
  int top_line_height;
  
  /* It's not always possible to find the cursor, e.g, when a window
     is full of overlay strings.  Don't do anything in that case.  */
  if (w->cursor.vpos < 0)
    return;
  
  matrix = w->desired_matrix;
  row = MATRIX_ROW (matrix, w->cursor.vpos);

  /* If row->y == top y of window display area, the window isn't tall
     enough to display a single line.  There is nothing we can do
     about it.  */
  top_line_height = WINDOW_DISPLAY_TOP_LINE_HEIGHT (w);
  if (row->y == top_line_height)
    return;

  if (MATRIX_ROW_PARTIALLY_VISIBLE_AT_TOP_P (w, row))
    {
      int dy = row->height - row->visible_height;
      w->vscroll = 0;
      w->cursor.y += dy;
      shift_glyph_matrix (w, matrix, 0, matrix->nrows, dy);
    }
  else if (MATRIX_ROW_PARTIALLY_VISIBLE_AT_BOTTOM_P (w, row))
    {
      int dy = - (row->height - row->visible_height);
      w->vscroll = dy;
      w->cursor.y += dy;
      shift_glyph_matrix (w, matrix, 0, matrix->nrows, dy);
    }

  /* When we change the cursor y-position of the selected window,
     change this_line_y as well so that the display optimization for
     the cursor line of the selected window in redisplay_internal uses
     the correct y-position.  */
  if (w == XWINDOW (selected_window))
    this_line_y = w->cursor.y;
}


/* Try scrolling PT into view in window WINDOW.  JUST_THIS_ONE_P
   non-zero means only WINDOW is redisplayed in redisplay_internal.
   TEMP_SCROLL_STEP has the same meaning as scroll_step, and is used
   in redisplay_window to bring a partially visible line into view in
   the case that only the cursor has moved.

   Value is

   1    if scrolling succeeded
    
   0    if scrolling didn't find point.
   
   -1   if new fonts have been loaded so that we must interrupt
   redisplay, adjust glyph matrices, and try again.  */

static int
try_scrolling (window, just_this_one_p, scroll_conservatively,
               scroll_step, temp_scroll_step)
     Lisp_Object window;
     int just_this_one_p;
     int scroll_conservatively, scroll_step;
     int temp_scroll_step;
{
  struct window *w = XWINDOW (window);
  struct frame *f = XFRAME (w->frame);
  struct text_pos scroll_margin_pos;
  struct text_pos pos;
  struct text_pos startp;
  struct it it;
  Lisp_Object window_end;
  int this_scroll_margin;
  int dy = 0;
  int scroll_max;
  int line_height, rc;
  int amount_to_scroll = 0;
  Lisp_Object aggressive;
  int height;

#if GLYPH_DEBUG
  debug_method_add (w, "try_scrolling");
#endif

  SET_TEXT_POS_FROM_MARKER (startp, w->start);
  
  /* Compute scroll margin height in pixels.  We scroll when point is
     within this distance from the top or bottom of the window.  */
  if (scroll_margin > 0)
    {
      this_scroll_margin = min (scroll_margin, XINT (w->height) / 4);
      this_scroll_margin *= CANON_Y_UNIT (f);
    }
  else
    this_scroll_margin = 0;

  /* Compute how much we should try to scroll maximally to bring point
     into view.  */
  if (scroll_step)
    scroll_max = scroll_step;
  else if (scroll_conservatively)
    scroll_max = scroll_conservatively;
  else if (temp_scroll_step)
    scroll_max = temp_scroll_step;
  else if (NUMBERP (current_buffer->scroll_down_aggressively)
           || NUMBERP (current_buffer->scroll_up_aggressively))
    /* We're trying to scroll because of aggressive scrolling
       but no scroll_step is set.  Choose an arbitrary one.  Maybe
       there should be a variable for this.  */
    scroll_max = 10;
  else
    scroll_max = 0;
  scroll_max *= CANON_Y_UNIT (f);

  /* Decide whether we have to scroll down.  Start at the window end
     and move this_scroll_margin up to find the position of the scroll
     margin.  */
  window_end = Fwindow_end (window, Qt);
  CHARPOS (scroll_margin_pos) = XINT (window_end);
  BYTEPOS (scroll_margin_pos) = CHAR_TO_BYTE (CHARPOS (scroll_margin_pos));
  if (this_scroll_margin)
    {
      start_display (&it, w, scroll_margin_pos);
      move_it_vertically (&it, - this_scroll_margin);
      scroll_margin_pos = it.current.pos;
    }

  if (PT >= CHARPOS (scroll_margin_pos))
    {
      int y0;
      
      /* Point is in the scroll margin at the bottom of the window, or
         below.  Compute a new window start that makes point visible.  */
      
      /* Compute the distance from the scroll margin to PT.
         Give up if the distance is greater than scroll_max.  */
      start_display (&it, w, scroll_margin_pos);
      y0 = it.current_y;
      move_it_to (&it, PT, 0, it.last_visible_y, -1,
                  MOVE_TO_POS | MOVE_TO_X | MOVE_TO_Y);
      line_height = (it.max_ascent + it.max_descent
                     ? it.max_ascent + it.max_descent
                     : last_height);
      dy = it.current_y + line_height - y0;
      if (dy > scroll_max)
        return 0;
      
      /* Move the window start down.  If scrolling conservatively,
         move it just enough down to make point visible.  If
         scroll_step is set, move it down by scroll_step.  */
      start_display (&it, w, startp);

      if (scroll_conservatively)
        amount_to_scroll = dy;
      else if (scroll_step || temp_scroll_step)
        amount_to_scroll = scroll_max;
      else
        {
          aggressive = current_buffer->scroll_down_aggressively;
          height = (WINDOW_DISPLAY_HEIGHT_NO_MODE_LINE (w)
                    - WINDOW_DISPLAY_TOP_LINE_HEIGHT (w));
          if (NUMBERP (aggressive))
            amount_to_scroll = XFLOATINT (aggressive) * height;
        }

      if (amount_to_scroll <= 0)
        return 0;

      move_it_vertically (&it, amount_to_scroll);
      startp = it.current.pos;
    }
  else
    {
      /* See if point is inside the scroll margin at the top of the
         window.  */
      scroll_margin_pos = startp;
      if (this_scroll_margin)
        {
          start_display (&it, w, startp);
          move_it_vertically (&it, this_scroll_margin);
          scroll_margin_pos = it.current.pos;
        }

      if (PT < CHARPOS (scroll_margin_pos))
        {
          /* Point is in the scroll margin at the top of the window or
             above what is displayed in the window.  */
          int y0;
          
          /* Compute the vertical distance from PT to the scroll
             margin position.  Give up if distance is greater than
             scroll_max.  */
          SET_TEXT_POS (pos, PT, PT_BYTE);
          start_display (&it, w, pos);
          y0 = it.current_y;
          move_it_to (&it, CHARPOS (scroll_margin_pos), 0,
                      it.last_visible_y, -1,
                      MOVE_TO_POS | MOVE_TO_X | MOVE_TO_Y);
          dy = it.current_y - y0;
          if (dy > scroll_max)
            return 0;
          
          /* Compute new window start.  */
          start_display (&it, w, startp);
          
          if (scroll_conservatively)
            amount_to_scroll = dy;
          else if (scroll_step || temp_scroll_step)
            amount_to_scroll = scroll_max;
          else
            {
              aggressive = current_buffer->scroll_up_aggressively;
              height = (WINDOW_DISPLAY_HEIGHT_NO_MODE_LINE (w)
                        - WINDOW_DISPLAY_TOP_LINE_HEIGHT (w));
              if (NUMBERP (aggressive))
                amount_to_scroll = XFLOATINT (aggressive) * height;
            }

          if (amount_to_scroll <= 0)
            return 0;
          
          move_it_vertically (&it, - amount_to_scroll);
          startp = it.current.pos;
        }
    }

  /* Run window scroll functions.  */
  startp = run_window_scroll_functions (window, startp);

  /* Display the window.  Give up if new fonts are loaded, or if point
     doesn't appear.  */
  if (!try_window (window, startp))
    rc = -1;
  else if (w->cursor.vpos < 0)
    {
      clear_glyph_matrix (w->desired_matrix);
      rc = 0;
    }
  else
    {
      /* Maybe forget recorded base line for line number display.  */
      if (!just_this_one_p 
          || current_buffer->clip_changed
          || beg_unchanged < CHARPOS (startp))
        w->base_line_number = Qnil;
      
      /* If cursor ends up on a partially visible line, shift display
         lines up or down.  */
      make_cursor_line_fully_visible (w);
      rc = 1;
    }

  return rc;
}


/* Compute a suitable window start for window W if display of W starts
   on a continuation line.  Value is non-zero if a new window start
   was computed.

   The new window start will be computed, based on W's width, starting
   from the start of the continued line.  It is the start of the
   screen line with the minimum distance from the old start W->start.  */

static int
compute_window_start_on_continuation_line (w)
     struct window *w;
{
  struct text_pos pos, start_pos;
  int window_start_changed_p = 0;

  SET_TEXT_POS_FROM_MARKER (start_pos, w->start);

  /* If window start is on a continuation line...  Window start may be
     < BEGV in case there's invisible text at the start of the 
     buffer (M-x rmail, for example).  */
  if (CHARPOS (start_pos) > BEGV
      && FETCH_BYTE (BYTEPOS (start_pos) - 1) != '\n')
    {
      struct it it;
      struct glyph_row *row;
      
      /* Find the start of the continued line.  This should be fast
         because scan_buffer is fast (newline cache).  */
      row = w->desired_matrix->rows + (WINDOW_WANTS_TOP_LINE_P (w) ? 1 : 0);
      init_iterator (&it, w, CHARPOS (start_pos), BYTEPOS (start_pos),
                     row, DEFAULT_FACE_ID);
      reseat_at_previous_visible_line_start (&it);

      /* If the line start is "too far" away from the window start,
         say it takes too much time to compute a new window start.  */
      if (CHARPOS (start_pos) - IT_CHARPOS (it)
          < XFASTINT (w->height) * XFASTINT (w->width))
        {
          int min_distance, distance;
          
          /* Move forward by display lines to find the new window
             start.  If window width was enlarged, the new start can
             be expected to be > the old start.  If window width was
             decreased, the new window start will be < the old start.
             So, we're looking for the display line start with the
             minimum distance from the old window start.  */
          pos = it.current.pos;
          min_distance = INFINITY;
          while ((distance = abs (CHARPOS (start_pos) - IT_CHARPOS (it))),
                 distance < min_distance)
            {
              min_distance = distance;
              pos = it.current.pos;
              move_it_by_lines (&it, 1, 0);
            }
          
          /* Set the window start there.  */
          SET_MARKER_FROM_TEXT_POS (w->start, pos);
          window_start_changed_p = 1;
        }
    }
  
  return window_start_changed_p;
}


/* Redisplay leaf window WINDOW.  JUST_THIS_ONE_P non-zero means only
   selected_window is redisplayed.  */

static void
redisplay_window (window, just_this_one_p)
     Lisp_Object window;
     int just_this_one_p;
{
  struct window *w = XWINDOW (window);
  struct frame *f = XFRAME (w->frame);
  struct buffer *buffer = XBUFFER (w->buffer);
  struct buffer *old = current_buffer;
  struct text_pos lpoint, opoint, startp;
  int update_mode_line;
  int tem;
  struct it it;
  /* Record it now because it's overwritten.  */
  int current_matrix_up_to_date_p = 0;
  int really_switched_buffer = 0;
  int temp_scroll_step = 0;
  int count = specpdl_ptr - specpdl;

  SET_TEXT_POS (lpoint, PT, PT_BYTE);
  opoint = lpoint;

  /* W must be a leaf window here.  */
  xassert (!NILP (w->buffer));
#if GLYPH_DEBUG
  *w->desired_matrix->method = 0;
#endif

  specbind (Qinhibit_point_motion_hooks, Qt);
  
  /* Has the mode line to be updated?  */ 
  update_mode_line = (!NILP (w->update_mode_line)
                      || update_mode_lines
                      || buffer->clip_changed);

  if (MINI_WINDOW_P (w))
    {
      if (w == XWINDOW (echo_area_window)
          && (echo_area_glyphs
              || STRINGP (echo_area_message)))
        {
          if (update_mode_line)
            /* We may have to update a tty frame's menu bar or a
               toolbar.  Example `M-x C-h C-h C-g'.  */
            goto finish_menu_bars;
          else
            /* We've already displayed the echo area glyphs in this window.  */
            goto finish_scroll_bars;
        }
      else if (w != XWINDOW (minibuf_window))
        {
          /* W is a mini-buffer window, but it's not the currently
             active one, so clear it.  */
          int yb = window_text_bottom_y (w);
          struct glyph_row *row;
          int y;

          for (y = 0, row = w->desired_matrix->rows;
               y < yb;
               y += row->height, ++row)
            blank_row (w, row, y);
          goto finish_scroll_bars;
        }
    }

  /* Otherwise set up data on this window; select its buffer and point
     value.  */
  if (update_mode_line)
    {
      /* Really select the buffer, for the sake of buffer-local
         variables.  */
      set_buffer_internal_1 (XBUFFER (w->buffer));
      really_switched_buffer = 1;
    }
  else
    set_buffer_temp (XBUFFER (w->buffer));
  SET_TEXT_POS (opoint, PT, PT_BYTE);

  current_matrix_up_to_date_p
    = (!NILP (w->window_end_valid)
       && !current_buffer->clip_changed
       && XFASTINT (w->last_modified) >= MODIFF
       && XFASTINT (w->last_overlay_modified) >= OVERLAY_MODIFF);

  /* When windows_or_buffers_changed is non-zero, we can't rely on
     the window end being valid, so set it to nil there.  */
  if (windows_or_buffers_changed)
    {
      /* If window starts on a continuation line, maybe adjust the
         window start in case the window's width changed.  */
      if (XMARKER (w->start)->buffer == current_buffer)
        compute_window_start_on_continuation_line (w);
      
      w->window_end_valid = Qnil;
    }

  /* Some sanity checks.  */
  CHECK_WINDOW_END (w);
  if (Z == Z_BYTE && CHARPOS (opoint) != BYTEPOS (opoint))
    abort ();
  if (BYTEPOS (opoint) < CHARPOS (opoint))
    abort ();

  /* If %c is in mode line, update it if needed.  */
  if (!NILP (w->column_number_displayed)
      /* This alternative quickly identifies a common case
         where no change is needed.  */
      && !(PT == XFASTINT (w->last_point)
           && XFASTINT (w->last_modified) >= MODIFF
           && XFASTINT (w->last_overlay_modified) >= OVERLAY_MODIFF)
      && XFASTINT (w->column_number_displayed) != current_column ())
    update_mode_line = 1; 

  /* Count number of windows showing the selected buffer.  An indirect
     buffer counts as its base buffer.  */
  if (!just_this_one_p)
    {
      struct buffer *current_base, *window_base;
      current_base = current_buffer;
      window_base = XBUFFER (XWINDOW (selected_window)->buffer);
      if (current_base->base_buffer)
        current_base = current_base->base_buffer;
      if (window_base->base_buffer)
        window_base = window_base->base_buffer;
      if (current_base == window_base)
        buffer_shared++;
    }

  /* Point refers normally to the selected window.  For any other
     window, set up appropriate value.  */
  if (!EQ (window, selected_window))
    {
      int new_pt = XMARKER (w->pointm)->charpos;
      int new_pt_byte = marker_byte_position (w->pointm);
      if (new_pt < BEGV)
        {
          new_pt = BEGV;
          new_pt_byte = BEGV_BYTE;
          set_marker_both (w->pointm, Qnil, BEGV, BEGV_BYTE);
        }
      else if (new_pt > (ZV - 1))
        {
          new_pt = ZV;
          new_pt_byte = ZV_BYTE;
          set_marker_both (w->pointm, Qnil, ZV, ZV_BYTE);
        }
      
      /* We don't use SET_PT so that the point-motion hooks don't run.  */
      TEMP_SET_PT_BOTH (new_pt, new_pt_byte);
    }

  /* If any of the character widths specified in the display table
     have changed, invalidate the width run cache.  It's true that
     this may be a bit late to catch such changes, but the rest of
     redisplay goes (non-fatally) haywire when the display table is
     changed, so why should we worry about doing any better?  */
  if (current_buffer->width_run_cache)
    {
      struct Lisp_Char_Table *disptab = buffer_display_table ();

      if (! disptab_matches_widthtab (disptab,
                                      XVECTOR (current_buffer->width_table)))
        {
          invalidate_region_cache (current_buffer,
                                   current_buffer->width_run_cache,
                                   BEG, Z);
          recompute_width_table (current_buffer, disptab);
        }
    }

  /* If window-start is screwed up, choose a new one.  */
  if (XMARKER (w->start)->buffer != current_buffer)
    goto recenter;

  SET_TEXT_POS_FROM_MARKER (startp, w->start);

  /* If someone specified a new starting point but did not insist,
     check whether it can be used.  */
  if (!NILP (w->optional_new_start))
    {
      w->optional_new_start = Qnil;
      /* This takes a mini-buffer prompt into account.  */
      start_display (&it, w, startp);
      move_it_to (&it, PT, 0, it.last_visible_y, -1,
                  MOVE_TO_POS | MOVE_TO_X | MOVE_TO_Y);
      if (IT_CHARPOS (it) == PT)
        w->force_start = Qt;
    }

  /* Handle case where place to start displaying has been specified,
     unless the specified location is outside the accessible range.  */
  if (!NILP (w->force_start))
    {
      w->force_start = Qnil;
      w->vscroll = 0;
      w->window_end_valid = Qnil;

      /* Forget any recorded base line for line number display.  */
      if (!current_matrix_up_to_date_p
          || current_buffer->clip_changed)
        w->base_line_number = Qnil;

      /* Redisplay the mode line.  Select the buffer properly for that.
         Also, run the hook window-scroll-functions
         because we have scrolled.  */
      /* Note, we do this after clearing force_start because
         if there's an error, it is better to forget about force_start
         than to get into an infinite loop calling the hook functions
         and having them get more errors.  */
      if (!update_mode_line
          || ! NILP (Vwindow_scroll_functions))
        {
          if (!really_switched_buffer)
            {
              set_buffer_temp (old);
              set_buffer_internal_1 (XBUFFER (w->buffer));
              really_switched_buffer = 1;
            }
          
          update_mode_line = 1;
          w->update_mode_line = Qt;
          startp = run_window_scroll_functions (window, startp);
        }
      
      XSETFASTINT (w->last_modified, 0);
      XSETFASTINT (w->last_overlay_modified, 0);
      if (CHARPOS (startp) < BEGV)
        SET_TEXT_POS (startp, BEGV, BEGV_BYTE);
      else if (CHARPOS (startp) > ZV)
        SET_TEXT_POS (startp, ZV, ZV_BYTE);
      
      /* Redisplay, then check if cursor has been set during the 
         redisplay.  Give up if new fonts were loaded.  */
      if (!try_window (window, startp))
        {
          w->force_start = Qt;
          clear_glyph_matrix (w->desired_matrix);
          goto restore_buffers;
        }

      if (w->cursor.vpos < 0)
        {
          /* If point does not appear, or on a line that is not fully
             visible, move point so it does appear.  The desired
             matrix has been built above, so we can use it.  */
          int height = window_box_height (w) / 2;
          struct glyph_row *row = MATRIX_ROW (w->desired_matrix, 0);
          
          while (row->y < height)
            ++row;

          TEMP_SET_PT_BOTH (MATRIX_ROW_START_CHARPOS (row),
                            MATRIX_ROW_START_BYTEPOS (row));

          if (w != XWINDOW (selected_window))
            set_marker_both (w->pointm, Qnil, PT, PT_BYTE);
          else if (current_buffer == old)
            SET_TEXT_POS (lpoint, PT, PT_BYTE);

          set_cursor_from_row (w, row, w->desired_matrix, 0, 0, 0, 0);
          
          /* If we are highlighting the region, then we just changed
             the region, so redisplay to show it.  */
          if (!NILP (Vtransient_mark_mode)
              && !NILP (current_buffer->mark_active))
            {
              clear_glyph_matrix (w->desired_matrix);
              if (!try_window (window, startp))
                goto restore_buffers;
            }
        }

      make_cursor_line_fully_visible (w);
#if GLYPH_DEBUG
      debug_method_add (w, "forced window start");
#endif
      goto done;
    }

  /* Handle case where text has not changed, only point, and it has
     not moved off the frame.  */
  if (current_matrix_up_to_date_p
      /* Point may be in this window.  */
      && PT >= CHARPOS (startp)
      /* If we don't check this, we are called to move the cursor in a
         horizontally split window with a current matrix that doesn't
         fit the display.  */
      && !windows_or_buffers_changed
      /* Selective display hasn't changed.  */
      && !current_buffer->clip_changed
      /* If force-mode-line-update was called, really redisplay;
         that's how redisplay is forced after e.g. changing
         buffer-invisibility-spec.  */
      && NILP (w->update_mode_line)
      /* Can't use this case if highlighting a region.  When a 
         region exists, cursor movement has to do more than just
         set the cursor.  */
      && !(!NILP (Vtransient_mark_mode)
           && !NILP (current_buffer->mark_active))
      && NILP (w->region_showing)
      /* Right after splitting windows, last_point may be nil.  */
      && INTEGERP (w->last_point)
      /* This code is not used for mini-buffer for the sake of the case
         of redisplaying to replace an echo area message; since in
         that case the mini-buffer contents per se are usually
         unchanged.  This code is of no real use in the mini-buffer
         since the handling of this_line_start_pos, etc., in redisplay
         handles the same cases.  */
      && !EQ (window, minibuf_window)
      /* When splitting windows or for new windows, it happens that
         redisplay is called with a nil window_end_vpos or one being
         larger than the window.  This should really be fixed in
         window.c.  I don't have this on my list, now, so we do
         approximately the same as the old redisplay code.  --gerd.  */
      && INTEGERP (w->window_end_vpos)
      && XFASTINT (w->window_end_vpos) < w->current_matrix->nrows
      && (FRAME_WINDOW_P (f)
          || !MARKERP (Voverlay_arrow_position)
          || current_buffer != XMARKER (Voverlay_arrow_position)->buffer))
    {
      int this_scroll_margin;
      struct glyph_row *row;
      int scroll_p;

#if GLYPH_DEBUG
      debug_method_add (w, "cursor movement");
#endif

      /* Scroll if point within this distance from the top or bottom
         of the window.  This is a pixel value.  */
      this_scroll_margin = max (0, scroll_margin);
      this_scroll_margin = min (this_scroll_margin, XFASTINT (w->height) / 4);
      this_scroll_margin *= CANON_Y_UNIT (f);

      /* Start with the row the cursor was displayed during the last
         not paused redisplay.  Give up if that row is not valid.  */
      if (w->last_cursor.vpos >= w->current_matrix->nrows)
        goto try_to_scroll;
      row = MATRIX_ROW (w->current_matrix, w->last_cursor.vpos);
      if (row->mode_line_p)
        ++row;
      if (!row->enabled_p)
        goto try_to_scroll;

      scroll_p = 0;
      if (PT > XFASTINT (w->last_point))
        {
          /* Point has moved forward.  */
          int last_y = window_text_bottom_y (w) - this_scroll_margin;
          
          while ((MATRIX_ROW_END_CHARPOS (row) < PT
                  /* The end position of a row equals the start
                     position of the next row.  If PT is there, we
                     would rather display it in the next line, except
                     when this line ends in ZV.  */
                  || (MATRIX_ROW_END_CHARPOS (row) == PT
                      && (MATRIX_ROW_ENDS_IN_MIDDLE_OF_CHAR_P (row)
                          || !row->ends_at_zv_p)))
                 && MATRIX_ROW_BOTTOM_Y (row) < last_y)
            {
              xassert (row->enabled_p);
              ++row;
            }

          /* If within the scroll margin, scroll.  Note that
             MATRIX_ROW_BOTTOM_Y gives the pixel position at which the
             next line would be drawn, and that this_scroll_margin can
             be zero.  */
          if (MATRIX_ROW_BOTTOM_Y (row) > last_y
              || PT > MATRIX_ROW_END_CHARPOS (row)
              /* Line is completely visible last line in window and PT
                 is to be set in the next line.  */
              || (MATRIX_ROW_BOTTOM_Y (row) == last_y
                  && PT == MATRIX_ROW_END_CHARPOS (row)
                  && !row->ends_at_zv_p
                  && !MATRIX_ROW_ENDS_IN_MIDDLE_OF_CHAR_P (row)))
            scroll_p = 1;
        }
      else if (PT < XFASTINT (w->last_point))
        {
          /* Cursor has to be moved backward.  Note that PT >=
             CHARPOS (startp) because of the outer if-statement.  */
          while (!row->mode_line_p
                 && (MATRIX_ROW_START_CHARPOS (row) > PT
                     || (MATRIX_ROW_START_CHARPOS (row) == PT
                         && MATRIX_ROW_STARTS_IN_MIDDLE_OF_CHAR_P (row)))
                 && (row->y > this_scroll_margin
                     || CHARPOS (startp) == BEGV))
            {
              xassert (row->enabled_p);
              --row;
            }

          /* Consider the following case: Window starts at BEGV, there
             is invisible, intangible text at BEGV, so that display
             starts at some point START > BEGV.  It can happen that
             we are called with PT somewhere between BEGV and START.
             Try to handle that case.  */
          if (row < w->current_matrix->rows
              || row->mode_line_p)
            {
              row = w->current_matrix->rows;
              if (row->mode_line_p)
                ++row;
            }

          /* Due to newlines in overlay strings, we may have to skip
             forward over overlay strings.  */
          while (MATRIX_ROW_END_CHARPOS (row) == PT
                 && MATRIX_ROW_ENDS_IN_OVERLAY_STRING_P (row)
                 && !row->ends_at_zv_p)
            ++row;
          
          /* If within the scroll margin, scroll.  */
          if (row->y < this_scroll_margin
              && CHARPOS (startp) != BEGV)
            scroll_p = 1;
        }

      /* if PT is not in the glyph row, give up.  */
      if (PT < MATRIX_ROW_START_CHARPOS (row)
          || PT > MATRIX_ROW_END_CHARPOS (row))
        goto try_to_scroll;

      /* If we end up in a partially visible line, let's make it fully
         visible.  This can be done most easily by using the existing
         scrolling code.  */
      if (MATRIX_ROW_PARTIALLY_VISIBLE_P (row))
        {
          temp_scroll_step = 1;
          goto try_to_scroll;
        }
      else if (scroll_p)
        goto try_to_scroll;
      
      set_cursor_from_row (w, row, w->current_matrix, 0, 0, 0, 0);
      goto done;
    }
  
  /* If current starting point was originally the beginning of a line
     but no longer is, find a new starting point.  */
  else if (!NILP (w->start_at_line_beg)
           && !(CHARPOS (startp) <= BEGV
                || FETCH_BYTE (BYTEPOS (startp) - 1) == '\n'))
    {
#if GLYPH_DEBUG
      debug_method_add (w, "recenter 1");
#endif
      goto recenter;
    }
  
  /* Try scrolling with try_window_id.  */
  else if (!windows_or_buffers_changed
           /* Window must be either use window-based redisplay or
              be full width.  */
           && (FRAME_WINDOW_P (f)
               || ((line_ins_del_ok && WINDOW_FULL_WIDTH_P (w))
                   && just_this_one_p))
           && !MINI_WINDOW_P (w)
           /* Point is not known NOT to appear in window.  */
           && PT >= CHARPOS (startp)
           && XFASTINT (w->last_modified)
           /* Window is not hscrolled.  */
           && XFASTINT (w->hscroll) == 0
           /* Selective display has not changed.  */
           && !current_buffer->clip_changed
           /* Current matrix is up to date.  */
           && !NILP (w->window_end_valid)
           /* Can't use this case if highlighting a region because
              a cursor movement will do more than just set the cursor.  */
           && !(!NILP (Vtransient_mark_mode)
                && !NILP (current_buffer->mark_active))
           && NILP (w->region_showing)
           /* Overlay arrow position and string not changed.  */
           && EQ (last_arrow_position, COERCE_MARKER (Voverlay_arrow_position))
           && EQ (last_arrow_string, Voverlay_arrow_string)
           /* Value is > 0 if update has been done, it is -1 if we
              know that the same window start will not work.  It is 0
              if unsuccessful for some other reason.  */
           && (tem = try_window_id (w)) != 0)
    {
#if GLYPH_DEBUG
      debug_method_add (w, "try_window_id");
#endif

      if (fonts_changed_p)
        goto restore_buffers;
      if (tem > 0)
        goto done;
      /* Otherwise try_window_id has returned -1 which means that we
         don't want the alternative below this comment to execute.  */
    }
  else if (CHARPOS (startp) >= BEGV
           && CHARPOS (startp) <= ZV
           && PT >= CHARPOS (startp)
           && (CHARPOS (startp) < ZV
               /* Avoid starting at end of buffer.  */
               || CHARPOS (startp) == BEGV
               || (XFASTINT (w->last_modified) >= MODIFF
                   && XFASTINT (w->last_overlay_modified) >= OVERLAY_MODIFF)))
    {
#if GLYPH_DEBUG
      debug_method_add (w, "same window start");
#endif
      
      /* Try to redisplay starting at same place as before.
         If point has not moved off frame, accept the results.  */
      if (!current_matrix_up_to_date_p
          /* Don't use try_window_reusing_current_matrix in this case
             because it can have changed the buffer.  */
          || !NILP (Vwindow_scroll_functions)
          || MINI_WINDOW_P (w)
          || !try_window_reusing_current_matrix (w))
        {
          IF_DEBUG (debug_method_add (w, "1"));
          try_window (window, startp);
        }

      if (fonts_changed_p)
        goto restore_buffers;
      
      if (w->cursor.vpos >= 0)
        {
          if (!just_this_one_p 
              || current_buffer->clip_changed
              || beg_unchanged < CHARPOS (startp))
            /* Forget any recorded base line for line number display.  */
            w->base_line_number = Qnil;
          
          make_cursor_line_fully_visible (w);
          goto done;
        }
      else
        clear_glyph_matrix (w->desired_matrix);
    }

 try_to_scroll:

  XSETFASTINT (w->last_modified, 0);
  XSETFASTINT (w->last_overlay_modified, 0);

  /* Redisplay the mode line.  Select the buffer properly for that.  */
  if (!update_mode_line)
    {
      if (!really_switched_buffer)
        {
          set_buffer_temp (old);
          set_buffer_internal_1 (XBUFFER (w->buffer));
          really_switched_buffer = 1;
        }
      update_mode_line = 1;
      w->update_mode_line = Qt;
    }

  /* Try to scroll by specified few lines.  */
  if ((scroll_conservatively
       || scroll_step
       || temp_scroll_step
       || NUMBERP (current_buffer->scroll_up_aggressively)
       || NUMBERP (current_buffer->scroll_down_aggressively))
      && !current_buffer->clip_changed
      && CHARPOS (startp) >= BEGV 
      && CHARPOS (startp) <= ZV)
    {
      /* The function returns -1 if new fonts were loaded, 1 if
         successful, 0 if not successful.  */
      int rc = try_scrolling (window, just_this_one_p,
                              scroll_conservatively,
                              scroll_step,
                              temp_scroll_step);
      if (rc > 0)
        goto done;
      else if (rc < 0)
        goto restore_buffers;
    }

  /* Finally, just choose place to start which centers point */

 recenter:

#if GLYPH_DEBUG
  debug_method_add (w, "recenter");
#endif

  /* w->vscroll = 0; */

  /* Forget any previously recorded base line for line number display.  */
  if (!current_matrix_up_to_date_p
      || current_buffer->clip_changed)
    w->base_line_number = Qnil;

  /* Move backward half the height of the window.  */
  init_iterator (&it, w, PT, PT_BYTE, NULL, DEFAULT_FACE_ID);
  it.current_y = it.last_visible_y;
  move_it_vertically_backward (&it, it.last_visible_y / 2);
  xassert (IT_CHARPOS (it) >= BEGV);

  /* The function move_it_vertically_backward may move over more
     than the specified y-distance.  If it->w is small, e.g. a
     mini-buffer window, we may end up in front of the window's
     display area.  Start displaying at the start of the line
     containing PT in this case.  */
  if (it.current_y <= 0)
    {
      init_iterator (&it, w, PT, PT_BYTE, NULL, DEFAULT_FACE_ID);
      move_it_vertically (&it, 0);
      xassert (IT_CHARPOS (it) <= PT);
      it.current_y = 0;
    }

  it.current_x = it.hpos = 0;
  
  /* Set startp here explicitly in case that helps avoid an infinite loop
     in case the window-scroll-functions functions get errors.  */
  set_marker_both (w->start, Qnil, IT_CHARPOS (it), IT_BYTEPOS (it));

  /* Run scroll hooks.  */
  startp = run_window_scroll_functions (window, it.current.pos);

  /* Redisplay the window.  */
  if (!current_matrix_up_to_date_p
      || windows_or_buffers_changed
      /* Don't use try_window_reusing_current_matrix in this case
         because it can have changed the buffer.  */
      || !NILP (Vwindow_scroll_functions)
      || !just_this_one_p
      || MINI_WINDOW_P (w)
      || !try_window_reusing_current_matrix (w))
    try_window (window, startp);

  /* If new fonts have been loaded (due to fontsets), give up.  We
     have to start a new redisplay since we need to re-adjust glyph
     matrices.  */
  if (fonts_changed_p)
    goto restore_buffers;

  /* If cursor did not appear assume that the middle of the window is
     in the first line of the window.  Do it again with the next line.
     (Imagine a window of height 100, displaying two lines of height
     60.  Moving back 50 from it->last_visible_y will end in the first
     line.)  */
  if (w->cursor.vpos < 0)
    {
      if (!NILP (w->window_end_valid)
          && PT >= Z - XFASTINT (w->window_end_pos))
        {
          clear_glyph_matrix (w->desired_matrix);
          move_it_by_lines (&it, 1, 0);
          try_window (window, it.current.pos);
        }
      else if (PT < IT_CHARPOS (it))
        {
          clear_glyph_matrix (w->desired_matrix);
          move_it_by_lines (&it, -1, 0);
          try_window (window, it.current.pos);
        }
      else
        {
          /* Not much we can do about it.  */
        }
    }

  /* Consider the following case: Window starts at BEGV, there is
     invisible, intangible text at BEGV, so that display starts at
     some point START > BEGV.  It can happen that we are called with
     PT somewhere between BEGV and START.  Try to handle that case.  */
  if (w->cursor.vpos < 0)
    {
      struct glyph_row *row = w->current_matrix->rows;
      if (row->mode_line_p)
        ++row;
      set_cursor_from_row (w, row, w->current_matrix, 0, 0, 0, 0);
    }
  
  make_cursor_line_fully_visible (w);

  SET_TEXT_POS_FROM_MARKER (startp, w->start);
  w->start_at_line_beg = ((CHARPOS (startp) == BEGV
                           || FETCH_BYTE (BYTEPOS (startp) - 1) == '\n')
                          ? Qt : Qnil);

 done:

  /* Display the mode line, if we must.  */
  if ((update_mode_line
       /* If window not full width, must redo its mode line
          if (a) the window to its side is being redone and 
          (b) we do a frame-based redisplay.  This is a consequence
          of how inverted lines are drawn in frame-based redisplay.  */
       || (!just_this_one_p 
           && !FRAME_WINDOW_P (f)
           && !WINDOW_FULL_WIDTH_P (w))
       /* Line number to display.  */
       || INTEGERP (w->base_line_pos)
       /* Column number is displayed and different from the one displayed.  */
       || (!NILP (w->column_number_displayed)
           && XFASTINT (w->column_number_displayed) != current_column ()))
       /* This means that the window has a mode line.  */
       && (WINDOW_WANTS_MODELINE_P (w)
           || WINDOW_WANTS_TOP_LINE_P (w)))
    {
      display_mode_lines (w);

      /* If mode line height has changed, arrange for a thorough
         immediate redisplay using the correct mode line height.  */
      if (WINDOW_WANTS_MODELINE_P (w)
          && CURRENT_MODE_LINE_HEIGHT (w) != DESIRED_MODE_LINE_HEIGHT (w))
        {
          fonts_changed_p = 1;
          MATRIX_MODE_LINE_ROW (w->current_matrix)->height
            = DESIRED_MODE_LINE_HEIGHT (w);
        }
      
      /* If top line height has changed, arrange for a thorough
         immediate redisplay using the correct mode line height.  */
      if (WINDOW_WANTS_TOP_LINE_P (w)
          && CURRENT_TOP_LINE_HEIGHT (w) != DESIRED_TOP_LINE_HEIGHT (w))
        {
          fonts_changed_p = 1;
          MATRIX_TOP_LINE_ROW (w->current_matrix)->height
            = DESIRED_TOP_LINE_HEIGHT (w);
        }

      if (fonts_changed_p)
        goto restore_buffers;
    }

  if (!line_number_displayed
      && !BUFFERP (w->base_line_pos))
    {
      w->base_line_pos = Qnil;
      w->base_line_number = Qnil;
    }

 finish_menu_bars:
  
  /* When we reach a frame's selected window, redo the frame's menu bar.  */
  if (update_mode_line
      && EQ (FRAME_SELECTED_WINDOW (f), window))
    {
      int redisplay_menu_p = 0;

      if (FRAME_WINDOW_P (f))
        {
#if defined (USE_X_TOOLKIT) || defined (HAVE_NTGUI)
          redisplay_menu_p = FRAME_EXTERNAL_MENU_BAR (f);
#else
          redisplay_menu_p = FRAME_MENU_BAR_LINES (f) > 0;
#endif
        }
      else
        redisplay_menu_p = FRAME_MENU_BAR_LINES (f) > 0;

      if (redisplay_menu_p)
        display_menu_bar (w);

#ifdef HAVE_WINDOW_SYSTEM
      if (WINDOWP (f->toolbar_window)
          && (FRAME_TOOLBAR_LINES (f) > 0
              || auto_resize_toolbars_p))
        redisplay_toolbar (f);
#endif
    }

 finish_scroll_bars:

  if (FRAME_HAS_VERTICAL_SCROLL_BARS (f))
    {
      int start, end, whole;

      /* Calculate the start and end positions for the current window.
         At some point, it would be nice to choose between scrollbars
         which reflect the whole buffer size, with special markers
         indicating narrowing, and scrollbars which reflect only the
         visible region.

         Note that mini-buffers sometimes aren't displaying any text.  */
      if (! MINI_WINDOW_P (w)
          || (w == XWINDOW (minibuf_window)
              && !echo_area_glyphs
              && !STRINGP (echo_area_message)))
        {
          whole = ZV - BEGV;
          start = marker_position (w->start) - BEGV;
          /* I don't think this is guaranteed to be right.  For the
             moment, we'll pretend it is.  */
          end = (Z - XFASTINT (w->window_end_pos)) - BEGV;

          if (end < start) 
            end = start;
          if (whole < (end - start)) 
            whole = end - start;
        }
      else
        start = end = whole = 0;

      /* Indicate what this scroll bar ought to be displaying now.  */
      (*set_vertical_scroll_bar_hook) (w, end - start, whole, start);

      /* Note that we actually used the scroll bar attached to this
         window, so it shouldn't be deleted at the end of redisplay.  */
      (*redeem_scroll_bar_hook) (w);
    }

 restore_buffers:

  /* Restore current_buffer and value of point in it.  */
  TEMP_SET_PT_BOTH (CHARPOS (opoint), BYTEPOS (opoint));
  if (really_switched_buffer)
    set_buffer_internal_1 (old);
  else
    set_buffer_temp (old);
  TEMP_SET_PT_BOTH (CHARPOS (lpoint), BYTEPOS (lpoint));

  unbind_to (count, Qnil);
}


/* Build the complete desired matrix of WINDOW with a window start
   buffer position POS.  Value is non-zero if successful.  It is zero
   if fonts were loaded during redisplay which makes re-adjusting
   glyph matrices necessary.  */

int
try_window (window, pos)
     Lisp_Object window;
     struct text_pos pos;
{
  struct window *w = XWINDOW (window);
  struct it it;
  struct glyph_row *last_text_row = NULL;

  /* Make POS the new window start.  */
  set_marker_both (w->start, Qnil, CHARPOS (pos), BYTEPOS (pos));

  /* Mark cursor position as unknown.  No overlay arrow seen.  */
  w->cursor.vpos = -1;
  overlay_arrow_seen = 0;

  /* Initialize iterator and info to start at POS.  */
  start_display (&it, w, pos);

  /* Display all lines of W.  */
  while (it.current_y < it.last_visible_y)
    {
      if (display_line (&it))
        last_text_row = it.glyph_row - 1;
      if (fonts_changed_p)
        return 0;
    }

  /* If bottom moved off end of frame, change mode line percentage.  */
  if (XFASTINT (w->window_end_pos) <= 0
      && Z != IT_CHARPOS (it))
    w->update_mode_line = Qt;

  /* Set window_end_pos to the offset of the last character displayed
     on the window from the end of current_buffer.  Set
     window_end_vpos to its row number.  */
  if (last_text_row)
    {
      xassert (MATRIX_ROW_DISPLAYS_TEXT_P (last_text_row));
      w->window_end_bytepos
        = Z_BYTE - MATRIX_ROW_END_BYTEPOS (last_text_row);
      XSETFASTINT (w->window_end_pos,
                   Z - MATRIX_ROW_END_CHARPOS (last_text_row));
      XSETFASTINT (w->window_end_vpos,
                   MATRIX_ROW_VPOS (last_text_row, w->desired_matrix));
      xassert (MATRIX_ROW (w->desired_matrix, XFASTINT (w->window_end_vpos))
               ->displays_text_p);
    }
  else
    {
      w->window_end_bytepos = 0;
      XSETFASTINT (w->window_end_pos, 0);
      XSETFASTINT (w->window_end_vpos, 0);
    }
  
  /* But that is not valid info until redisplay finishes.  */
  w->window_end_valid = Qnil;
  return 1;
}


\f
/************************************************************************
    Window redisplay reusing current matrix when buffer has not changed
 ************************************************************************/

/* Try redisplay of window W showing an unchanged buffer with a
   different window start than the last time it was displayed by
   reusing its current matrix.  Value is non-zero if successful.
   W->start is the new window start.  */

static int
try_window_reusing_current_matrix (w)
     struct window *w;
{
  struct frame *f = XFRAME (w->frame);
  struct glyph_row *row, *bottom_row;
  struct it it;
  struct run run;
  struct text_pos start, new_start;
  int nrows_scrolled, i;
  struct glyph_row *last_text_row;
  struct glyph_row *last_reused_text_row;
  struct glyph_row *start_row;
  int start_vpos, min_y, max_y;

  /* Right now this function doesn't handle terminal frames.  */
  if (!FRAME_WINDOW_P (f))
    return 0;

  /* Can't do this if region may have changed.  */
  if ((!NILP (Vtransient_mark_mode)
       && !NILP (current_buffer->mark_active))
      || !NILP (w->region_showing))
    return 0;

  /* If top-line visibility has changed, give up.  */
  if (WINDOW_WANTS_TOP_LINE_P (w)
      != MATRIX_TOP_LINE_ROW (w->current_matrix)->mode_line_p)
    return 0;

  /* Give up if old or new display is scrolled vertically.  We could
     make this function handle this, but right now it doesn't.  */
  start_row = MATRIX_FIRST_TEXT_ROW (w->current_matrix);
  if (w->vscroll || MATRIX_ROW_PARTIALLY_VISIBLE_P (start_row))
    return 0;

  /* The variable new_start now holds the new window start.  The old
     start `start' can be determined from the current matrix.  */
  SET_TEXT_POS_FROM_MARKER (new_start, w->start);
  start = start_row->start.pos;
  start_vpos = MATRIX_ROW_VPOS (start_row, w->current_matrix);

  /* Clear the desired matrix for the display below.  */
  clear_glyph_matrix (w->desired_matrix);
  
  if (CHARPOS (new_start) <= CHARPOS (start))
    {
      int first_row_y;
      
      IF_DEBUG (debug_method_add (w, "twu1"));
      
      /* Display up to a row that can be reused.  The variable
         last_text_row is set to the last row displayed that displays
         text.  */
      start_display (&it, w, new_start);
      first_row_y = it.current_y;
      w->cursor.vpos = -1;
      last_text_row = last_reused_text_row = NULL;
      while (it.current_y < it.last_visible_y
             && IT_CHARPOS (it) < CHARPOS (start)
             && !fonts_changed_p)
        if (display_line (&it))
          last_text_row = it.glyph_row - 1;

      /* A value of current_y < last_visible_y means that we stopped
         at the previous window start, which in turn means that we
         have at least one reusable row.  */
      if (it.current_y < it.last_visible_y)
        {
          nrows_scrolled = it.vpos;
          
          /* Find PT if not already found in the lines displayed.  */
          if (w->cursor.vpos < 0)
            {
              int dy = it.current_y - first_row_y;
              
              row = MATRIX_FIRST_TEXT_ROW (w->current_matrix);
              while (MATRIX_ROW_DISPLAYS_TEXT_P (row))
                {
                  if (PT >= MATRIX_ROW_START_CHARPOS (row)
                      && PT < MATRIX_ROW_END_CHARPOS (row))
                    {
                      set_cursor_from_row (w, row, w->current_matrix, 0, 0,
                                           dy, nrows_scrolled);
                      break;
                    }
                  
                  if (MATRIX_ROW_BOTTOM_Y (row) + dy >= it.last_visible_y)
                    break;
                  
                  ++row;
                }
              
              /* Give up if point was not found.  This shouldn't
                 happen often; not more often than with try_window
                 itself.  */
              if (w->cursor.vpos < 0)
                {
                  clear_glyph_matrix (w->desired_matrix);
                  return 0;
                }
            }

          /* Scroll the display.  Do it before the current matrix is
             changed.  The problem here is that update has not yet
             run, i.e. part of the current matrix is not up to date.
             scroll_run_hook will clear the cursor, and use the
             current matrix to get the height of the row the cursor is
             in.  */
          run.current_y = first_row_y;
          run.desired_y = it.current_y;
          run.height = it.last_visible_y - it.current_y;
          if (run.height > 0)
            {
              update_begin (f);
              rif->update_window_begin_hook (w);
              rif->scroll_run_hook (w, &run);
              rif->update_window_end_hook (w, 0);
              update_end (f);
            }

          /* Shift current matrix down by nrows_scrolled lines.  */
          bottom_row = MATRIX_BOTTOM_TEXT_ROW (w->current_matrix, w);
          rotate_matrix (w->current_matrix,
                         start_vpos,
                         MATRIX_ROW_VPOS (bottom_row, w->current_matrix),
                         nrows_scrolled);
          
          /* Disable lines not reused.  */
          for (i = 0; i < it.vpos; ++i)
            MATRIX_ROW (w->current_matrix, i)->enabled_p = 0;
          
          /* Re-compute Y positions.  */
          row = MATRIX_FIRST_TEXT_ROW (w->current_matrix) + nrows_scrolled;
          min_y = WINDOW_DISPLAY_TOP_LINE_HEIGHT (w);
          max_y = it.last_visible_y;
          while (row < bottom_row)
            {
              row->y = it.current_y;

              if (row->y < min_y)
                row->visible_height = row->height - (min_y - row->y);
              else if (row->y + row->height > max_y)
                row->visible_height
                  = row->height - (row->y + row->height - max_y);
              else
                row->visible_height = row->height;
              
              it.current_y += row->height;
              ++it.vpos;

              if (MATRIX_ROW_DISPLAYS_TEXT_P (row))
                last_reused_text_row = row;
              if (MATRIX_ROW_BOTTOM_Y (row) >= it.last_visible_y)
                break;
              ++row;
            }
        }

      /* Update window_end_pos etc.; last_reused_text_row is the last
         reused row from the current matrix containing text, if any.
         The value of last_text_row is the last displayed line
         containing text.  */
      if (last_reused_text_row)
        {
          w->window_end_bytepos
            = Z_BYTE - MATRIX_ROW_END_BYTEPOS (last_reused_text_row);
          XSETFASTINT (w->window_end_pos,
                       Z - MATRIX_ROW_END_CHARPOS (last_reused_text_row));
          XSETFASTINT (w->window_end_vpos,
                       MATRIX_ROW_VPOS (last_reused_text_row,
                                        w->current_matrix));
        }
      else if (last_text_row)
        {
          w->window_end_bytepos
            = Z_BYTE - MATRIX_ROW_END_BYTEPOS (last_text_row);
          XSETFASTINT (w->window_end_pos,
                       Z - MATRIX_ROW_END_CHARPOS (last_text_row));
          XSETFASTINT (w->window_end_vpos,
                       MATRIX_ROW_VPOS (last_text_row, w->desired_matrix));
        }
      else
        {
          /* This window must be completely empty.  */
          w->window_end_bytepos = 0;
          XSETFASTINT (w->window_end_pos, 0);
          XSETFASTINT (w->window_end_vpos, 0);
        }
      w->window_end_valid = Qnil;

      /* Update hint: don't try scrolling again in update_window.  */
      w->desired_matrix->no_scrolling_p = 1;
      
#if GLYPH_DEBUG
      debug_method_add (w, "try_window_reusing_current_matrix 1");
#endif
      return 1;
    }
  else if (CHARPOS (new_start) > CHARPOS (start))
    {
      struct glyph_row *pt_row, *row;
      struct glyph_row *first_reusable_row;
      struct glyph_row *first_row_to_display;
      int dy;
      int yb = window_text_bottom_y (w);

      IF_DEBUG (debug_method_add (w, "twu2"));
      
      /* Find the row starting at new_start, if there is one.  Don't
         reuse a partially visible line at the end.  */
      first_reusable_row = MATRIX_FIRST_TEXT_ROW (w->current_matrix);
      while (first_reusable_row->enabled_p
             && MATRIX_ROW_BOTTOM_Y (first_reusable_row) < yb
             && (MATRIX_ROW_START_CHARPOS (first_reusable_row)
                 < CHARPOS (new_start)))
        ++first_reusable_row;

      /* Give up if there is no row to reuse.  */
      if (MATRIX_ROW_BOTTOM_Y (first_reusable_row) >= yb
          || !first_reusable_row->enabled_p)
        return 0;

      /* The row we found must start at new_start, or else something
         is broken.  */
      xassert (MATRIX_ROW_START_CHARPOS (first_reusable_row)
               == CHARPOS (new_start));
      
      /* We can reuse fully visible rows beginning with
         first_reusable_row to the end of the window.  Set
         first_row_to_display to the first row that cannot be reused.
         Set pt_row to the row containing point, if there is any.  */
      first_row_to_display = first_reusable_row;
      pt_row = NULL;
      while (MATRIX_ROW_BOTTOM_Y (first_row_to_display) < yb)
        {
          if (PT >= MATRIX_ROW_START_CHARPOS (first_row_to_display)
              && PT < MATRIX_ROW_END_CHARPOS (first_row_to_display))
            pt_row = first_row_to_display;

          ++first_row_to_display;
        }

      /* Start displaying at the start of first_row_to_display.  */
      xassert (first_row_to_display->y < yb);
      init_to_row_start (&it, w, first_row_to_display);
      nrows_scrolled = MATRIX_ROW_VPOS (first_reusable_row, w->current_matrix);
      it.vpos = (MATRIX_ROW_VPOS (first_row_to_display, w->current_matrix)
                 - nrows_scrolled);
      it.current_y = first_row_to_display->y - first_reusable_row->y;

      /* Display lines beginning with first_row_to_display in the
         desired matrix.  Set last_text_row to the last row displayed
         that displays text.  */
      it.glyph_row = MATRIX_ROW (w->desired_matrix, it.vpos);
      if (pt_row == NULL)
        w->cursor.vpos = -1;
      last_text_row = NULL;
      while (it.current_y < it.last_visible_y && !fonts_changed_p)
        if (display_line (&it))
          last_text_row = it.glyph_row - 1;

      /* Give up If point isn't in a row displayed or reused.  */
      if (w->cursor.vpos < 0)
        {
          clear_glyph_matrix (w->desired_matrix);
          return 0;
        }

      /* If point is in a reused row, adjust y and vpos of the cursor
         position.  */
      if (pt_row)
        {
          w->cursor.vpos -= MATRIX_ROW_VPOS (first_reusable_row,
                                             w->current_matrix);
          w->cursor.y -= first_reusable_row->y;
        }

      /* Scroll the display.  */
      run.current_y = first_reusable_row->y;
      run.desired_y = WINDOW_DISPLAY_TOP_LINE_HEIGHT (w);
      run.height = it.last_visible_y - run.current_y;
      if (run.height)
        {
          struct frame *f = XFRAME (WINDOW_FRAME (w));
          update_begin (f);
          rif->update_window_begin_hook (w);
          rif->scroll_run_hook (w, &run);
          rif->update_window_end_hook (w, 0);
          update_end (f);
        }

      /* Adjust Y positions of reused rows.  */
      bottom_row = MATRIX_BOTTOM_TEXT_ROW (w->current_matrix, w);
      row = first_reusable_row;
      dy = first_reusable_row->y;
      min_y = WINDOW_DISPLAY_TOP_LINE_HEIGHT (w);
      max_y = it.last_visible_y;
      while (row < first_row_to_display)
        {
          row->y -= dy;
          if (row->y < min_y)
            row->visible_height = row->height - (min_y - row->y);
          else if (row->y + row->height > max_y)
            row->visible_height
              = row->height - (row->y + row->height - max_y);
          else
            row->visible_height = row->height;
          ++row;
        }

      /* Disable rows not reused.  */
      while (row < bottom_row)
        {
          row->enabled_p = 0;
          ++row;
        }

      /* Scroll the current matrix.  */
      xassert (nrows_scrolled > 0);
      rotate_matrix (w->current_matrix,
                     start_vpos,
                     MATRIX_ROW_VPOS (bottom_row, w->current_matrix),
                     -nrows_scrolled);

      /* Adjust window end.  A null value of last_text_row means that
         the window end is in reused rows which in turn means that
         only its vpos can have changed.  */
      if (last_text_row)
        {
          w->window_end_bytepos
            = Z_BYTE - MATRIX_ROW_END_BYTEPOS (last_text_row);
          XSETFASTINT (w->window_end_pos,
                       Z - MATRIX_ROW_END_CHARPOS (last_text_row));
          XSETFASTINT (w->window_end_vpos,
                       MATRIX_ROW_VPOS (last_text_row, w->desired_matrix));
        }
      else
        {
          XSETFASTINT (w->window_end_vpos,
                       XFASTINT (w->window_end_vpos) - nrows_scrolled);
        }
      
      w->window_end_valid = Qnil;
      w->desired_matrix->no_scrolling_p = 1;

#if GLYPH_DEBUG
      debug_method_add (w, "try_window_reusing_current_matrix 2");
#endif
      return 1;
    }
  
  return 0;
}


\f
/************************************************************************
   Window redisplay reusing current matrix when buffer has changed
 ************************************************************************/

static struct glyph_row *get_last_unchanged_at_beg_row P_ ((struct window *));
static struct glyph_row *get_first_unchanged_at_end_row P_ ((struct window *,
                                                             int *, int *));
static struct glyph_row *
find_last_row_displaying_text P_ ((struct glyph_matrix *, struct it *,
                                   struct glyph_row *));


/* Return the last row in MATRIX displaying text.  If row START is
   non-null, start searching with that row.  IT gives the dimensions
   of the display.  Value is null if matrix is empty; otherwise it is
   a pointer to the row found.  */

static struct glyph_row *
find_last_row_displaying_text (matrix, it, start)
     struct glyph_matrix *matrix;
     struct it *it;
     struct glyph_row *start;
{
  struct glyph_row *row, *row_found;

  /* Set row_found to the last row in IT->w's current matrix
     displaying text.  The loop looks funny but think of partially
     visible lines.  */
  row_found = NULL;
  row = start ? start : MATRIX_FIRST_TEXT_ROW (matrix);
  while (MATRIX_ROW_DISPLAYS_TEXT_P (row))
    {
      xassert (row->enabled_p);
      row_found = row;
      if (MATRIX_ROW_BOTTOM_Y (row) >= it->last_visible_y)
        break;
      ++row;
    }
  
  return row_found;
}


/* Return the last row in the current matrix of W that is not affected
   by changes at the start of current_buffer that occurred since the
   last time W was redisplayed.  Value is null if no such row exists.

   The global variable beg_unchanged has to contain the number of
   bytes unchanged at the start of current_buffer.  BEG +
   beg_unchanged is the buffer position of the first changed byte in
   current_buffer.  Characters at positions < BEG + beg_unchanged are
   at the same buffer positions as they were when the current matrix
   was built.  */

static struct glyph_row *
get_last_unchanged_at_beg_row (w)
     struct window *w;
{
  int first_changed_pos = BEG + beg_unchanged;
  struct glyph_row *row;
  struct glyph_row *row_found = NULL;
  int yb = window_text_bottom_y (w);

  /* Find the last row displaying unchanged text.  */
  row = MATRIX_FIRST_TEXT_ROW (w->current_matrix);
  while (MATRIX_ROW_DISPLAYS_TEXT_P (row)
         && MATRIX_ROW_START_CHARPOS (row) < first_changed_pos)
    {
      if (/* If row ends before first_changed_pos, it is unchanged,
             except in some case.  */
          MATRIX_ROW_END_CHARPOS (row) <= first_changed_pos
          /* When row ends in ZV and we write at ZV it is not
             unchanged.  */
          && !row->ends_at_zv_p
          /* When first_changed_pos is the end of a continued line,
             row is not unchanged because it may be no longer
             continued.  */
          && !(MATRIX_ROW_END_CHARPOS (row) == first_changed_pos
               && row->continued_p))
        row_found = row;

      /* Stop if last visible row.  */
     if (MATRIX_ROW_BOTTOM_Y (row) >= yb)
        break;
      
      ++row;
    }

  return row_found;
}


/* Find the first glyph row in the current matrix of W that is not
   affected by changes at the end of current_buffer since the last
   time the window was redisplayed.  Return in *DELTA the number of
   bytes by which buffer positions in unchanged text at the end of
   current_buffer must be adjusted.  Value is null if no such row
   exists, i.e. all rows are affected by changes.

   The global variable end_unchanged is assumed to contain the number
   of unchanged bytes at the end of current_buffer.  The buffer
   position of the last changed byte in current_buffer is then Z -
   end_unchanged.  */
   
static struct glyph_row *
get_first_unchanged_at_end_row (w, delta, delta_bytes)
     struct window *w;
     int *delta, *delta_bytes;
{
  struct glyph_row *row;
  struct glyph_row *row_found = NULL;

  *delta = *delta_bytes = 0;

  /* A value of window_end_pos >= end_unchanged means that the window
     end is in the range of changed text.  If so, there is no
     unchanged row at the end of W's current matrix.  */
  xassert (!NILP (w->window_end_valid));
  if (XFASTINT (w->window_end_pos) >= end_unchanged)
    return NULL;

  /* Set row to the last row in W's current matrix displaying text.  */
  row = MATRIX_ROW (w->current_matrix, XFASTINT (w->window_end_vpos));
  
  /* End vpos should always be on text, except in an entirely empty
     matrix.  */
  xassert (MATRIX_ROW_DISPLAYS_TEXT_P (row)
           || MATRIX_ROW_VPOS (row, w->current_matrix) == 0);

  /* If matrix is entirely empty, no unchanged row exists.  */ 
  if (MATRIX_ROW_DISPLAYS_TEXT_P (row))
    {
      /* The value of row is the last glyph row in the matrix having a
         meaningful buffer position in it.  The end position of row
         corresponds to window_end_pos.  This allows us to translate
         buffer positions in the current matrix to current buffer
         positions for characters not in changed text.  */
      int Z_old = MATRIX_ROW_END_CHARPOS (row) + XFASTINT (w->window_end_pos);
      int Z_BYTE_old = MATRIX_ROW_END_BYTEPOS (row) + w->window_end_bytepos;
      int last_unchanged_pos, last_unchanged_pos_old;
      struct glyph_row *first_text_row
        = MATRIX_FIRST_TEXT_ROW (w->current_matrix);

      *delta = Z - Z_old;
      *delta_bytes = Z_BYTE - Z_BYTE_old;

      /* Set last_unchanged_pos to the buffer position of the last
         character in the buffer that has not been changed.  Z is the
         index + 1 of the last byte in current_buffer, i.e. by
         subtracting end_unchanged we get the index of the last
         unchanged character, and we have to add BEG to get its buffer
         position.  */
      last_unchanged_pos = Z - end_unchanged + BEG;
      last_unchanged_pos_old = last_unchanged_pos - *delta;
      
      /* Search backward from ROW for a row displaying a line that
         starts at a minimum position >= last_unchanged_pos_old.  */
      while (row >= first_text_row)
        {
          xassert (row->enabled_p);
          xassert (MATRIX_ROW_DISPLAYS_TEXT_P (row));
          
          if (MATRIX_ROW_START_CHARPOS (row) >= last_unchanged_pos_old)
            row_found = row;
          --row;
        }
    }

  xassert (!row_found || MATRIX_ROW_DISPLAYS_TEXT_P (row_found));
  return row_found;
}


/* Make sure that glyph rows in the current matrix of window W
   reference the same glyph memory as corresponding rows in the
   frame's frame matrix.  This function is called after scrolling W's
   current matrix on a terminal frame in try_window_id and
   try_window_reusing_current_matrix.  */

static void
sync_frame_with_window_matrix_rows (w)
     struct window *w;
{
  struct frame *f = XFRAME (w->frame);
  struct glyph_row *window_row, *window_row_end, *frame_row;

  /* Preconditions: W must be a leaf window and full-width.  Its frame
     must have a frame matrix.  */
  xassert (NILP (w->hchild) && NILP (w->vchild));
  xassert (WINDOW_FULL_WIDTH_P (w));
  xassert (!FRAME_WINDOW_P (f));

  /* If W is a full-width window, glyph pointers in W's current matrix
     have, by definition, to be the same as glyph pointers in the
     corresponding frame matrix.  */
  window_row = w->current_matrix->rows;
  window_row_end = window_row + w->current_matrix->nrows;
  frame_row = f->current_matrix->rows + XFASTINT (w->top);
  while (window_row < window_row_end)
    {
      int area;
      for (area = LEFT_MARGIN_AREA; area <= LAST_AREA; ++area)
        frame_row->glyphs[area] = window_row->glyphs[area];
      ++window_row, ++frame_row;
    }
}


/* Try to redisplay window W by reusing its existing display.  W's
   current matrix must be up to date when this function is called,
   i.e. window_end_valid must not be nil.

   Value is

   1    if display has been updated
   0    if otherwise unsuccessful
   -1   if redisplay with same window start is known not to succeed

   The following steps are performed:

   1. Find the last row in the current matrix of W that is not
   affected by changes at the start of current_buffer.  If no such row
   is found, give up.

   2. Find the first row in W's current matrix that is not affected by
   changes at the end of current_buffer.  Maybe there is no such row.

   3. Display lines beginning with the row + 1 found in step 1 to the
   row found in step 2 or, if step 2 didn't find a row, to the end of
   the window.

   4. If cursor is not known to appear on the window, give up.

   5. If display stopped at the row found in step 2, scroll the
   display and current matrix as needed.

   6. Maybe display some lines at the end of W, if we must.  This can
   happen under various circumstances, like a partially visible line
   becoming fully visible, or because newly displayed lines are displayed
   in smaller font sizes.

   7. Update W's window end information.  */

  /* Check that window end is what we expect it to be.  */

static int
try_window_id (w)
     struct window *w;
{
  struct frame *f = XFRAME (w->frame);
  struct glyph_matrix *current_matrix = w->current_matrix;
  struct glyph_matrix *desired_matrix = w->desired_matrix;
  struct glyph_row *last_unchanged_at_beg_row;
  struct glyph_row *first_unchanged_at_end_row;
  struct glyph_row *row;
  struct glyph_row *bottom_row;
  int bottom_vpos;
  struct it it;
  int delta = 0, delta_bytes = 0, stop_pos, dvpos, dy;
  struct text_pos start_pos;
  struct run run;
  int first_unchanged_at_end_vpos = 0;
  struct glyph_row *last_text_row, *last_text_row_at_end;
  struct text_pos start;

  SET_TEXT_POS_FROM_MARKER (start, w->start);

  /* Check pre-conditions.  Window end must be valid, otherwise
     the current matrix would not be up to date.  */
  xassert (!NILP (w->window_end_valid));
  xassert (FRAME_WINDOW_P (XFRAME (w->frame))
           || (line_ins_del_ok && WINDOW_FULL_WIDTH_P (w)));

  /* Make sure beg_unchanged and end_unchanged are up to date.  Do it
     only if buffer has really changed.  The reason is that the gap is
     initially at Z for freshly visited files.  The code below would
     set end_unchanged to 0 in that case.  */
  if (MODIFF > SAVE_MODIFF)
    {
      if (GPT - BEG < beg_unchanged)
        beg_unchanged = GPT - BEG;
      if (Z - GPT < end_unchanged)
        end_unchanged = Z - GPT;
    }
  
  /* If window starts after a line end, and the last change is in
     front of that newline, then changes don't affect the display.
     This case happens with stealth-fontification.  */
  row = MATRIX_ROW (w->current_matrix, XFASTINT (w->window_end_vpos));
  if (CHARPOS (start) > BEGV
      && Z - end_unchanged < CHARPOS (start) - 1
      && FETCH_BYTE (BYTEPOS (start) - 1) == '\n'
      && PT < MATRIX_ROW_END_CHARPOS (row))
    {
      /* We have to update window end positions because the buffer's
         size has changed.  */
      w->window_end_pos
        = make_number (Z - MATRIX_ROW_END_CHARPOS (row));
      w->window_end_bytepos
        = make_number (Z_BYTE - MATRIX_ROW_END_BYTEPOS (row));
      return 1;
    }

  /* Return quickly if changes are all below what is displayed in the
     window, and if PT is in the window.  */
  if (beg_unchanged > MATRIX_ROW_END_CHARPOS (row)
      && PT < MATRIX_ROW_END_CHARPOS (row))
    {
      /* We have to update window end positions because the buffer's
         size has changed.  */
      w->window_end_pos
        = make_number (Z - MATRIX_ROW_END_CHARPOS (row));
      w->window_end_bytepos
        = make_number (Z_BYTE - MATRIX_ROW_END_BYTEPOS (row));
      return 1;
    }

  /* Check that window start agrees with the start of the first glyph
     row in its current matrix.  Check this after we know the window
     start is not in changed text, otherwise positions would not be
     comparable.  */
  row = MATRIX_FIRST_TEXT_ROW (w->current_matrix);
  if (!TEXT_POS_EQUAL_P (start, row->start.pos))
    return 0;

  /* Remember beg_unchanged and end_unchanged for debugging purposes.  */
  IF_DEBUG (debug_beg_unchanged = beg_unchanged;
            debug_end_unchanged = end_unchanged);

  /* Compute the position at which we have to start displaying new
     lines.  Some of the lines at the top of the window might be
     reusable because they are not displaying changed text.  Find the
     last row in W's current matrix not affected by changes at the
     start of current_buffer.  Value is null if changes start in the
     first line of window.  */
  last_unchanged_at_beg_row = get_last_unchanged_at_beg_row (w);
  if (last_unchanged_at_beg_row)
    {
      init_to_row_end (&it, w, last_unchanged_at_beg_row);
      start_pos = it.current.pos;
      
      /* Start displaying new lines in the desired matrix at the same
         vpos we would use in the current matrix, i.e. below
         last_unchanged_at_beg_row.  */
      it.vpos = 1 + MATRIX_ROW_VPOS (last_unchanged_at_beg_row,
                                     current_matrix);
      it.glyph_row = MATRIX_ROW (desired_matrix, it.vpos);
      it.current_y = MATRIX_ROW_BOTTOM_Y (last_unchanged_at_beg_row);

      xassert (it.hpos == 0 && it.current_x == 0);
    }
  else
    {
      /* There are no reusable lines at the start of the window.
         Start displaying in the first line.  */
      start_display (&it, w, start);
      start_pos = it.current.pos;
    }

  bottom_row = MATRIX_BOTTOM_TEXT_ROW (current_matrix, w);
  bottom_vpos = MATRIX_ROW_VPOS (bottom_row, current_matrix);
  
  /* Find the first row that is not affected by changes at the end of
     the buffer.  Value will be null if there is no unchanged row, in
     which case we must redisplay to the end of the window.  delta
     will be set to the value by which buffer positions beginning with
     first_unchanged_at_end_row have to be adjusted due to text
     changes.  */
  first_unchanged_at_end_row
    = get_first_unchanged_at_end_row (w, &delta, &delta_bytes);
  IF_DEBUG (debug_delta = delta);
  IF_DEBUG (debug_delta_bytes = delta_bytes);
  
  /* Set stop_pos to the buffer position up to which we will have to
     display new lines.  If first_unchanged_at_end_row != NULL, this
     is the buffer position of the start of the line displayed in that
     row.  For first_unchanged_at_end_row == NULL, use 0 to indicate
     that we don't stop at a buffer position.  */
  stop_pos = 0;
  if (first_unchanged_at_end_row)
    {
      xassert (last_unchanged_at_beg_row == NULL
               || first_unchanged_at_end_row >= last_unchanged_at_beg_row);
      
      /* If this is a continuation line, move forward to the next one
         that isn't.  Changes in lines above affect this line.
         Caution: this may move first_unchanged_at_end_row to a row
         not displaying text.  */
      while (MATRIX_ROW_CONTINUATION_LINE_P (first_unchanged_at_end_row)
             && MATRIX_ROW_DISPLAYS_TEXT_P (first_unchanged_at_end_row)
             && (MATRIX_ROW_BOTTOM_Y (first_unchanged_at_end_row)
                 < it.last_visible_y))
        ++first_unchanged_at_end_row;

      if (!MATRIX_ROW_DISPLAYS_TEXT_P (first_unchanged_at_end_row)
          || (MATRIX_ROW_BOTTOM_Y (first_unchanged_at_end_row)
              >= it.last_visible_y))
        first_unchanged_at_end_row = NULL;
      else
        {
          stop_pos = (MATRIX_ROW_START_CHARPOS (first_unchanged_at_end_row)
                      + delta);
          first_unchanged_at_end_vpos
            = MATRIX_ROW_VPOS (first_unchanged_at_end_row, current_matrix);
          xassert (stop_pos >= Z - end_unchanged);
        }
    }
  else if (last_unchanged_at_beg_row == NULL)
    return 0;


#if GLYPH_DEBUG
  
  /* Either there is no unchanged row at the end, or the one we have
     now displays text.  This is a necessary condition for the window
     end pos calculation at the end of this function.  */
  xassert (first_unchanged_at_end_row == NULL
           || MATRIX_ROW_DISPLAYS_TEXT_P (first_unchanged_at_end_row));
  
  debug_last_unchanged_at_beg_vpos
    = (last_unchanged_at_beg_row
       ? MATRIX_ROW_VPOS (last_unchanged_at_beg_row, current_matrix)
       : -1);
  debug_first_unchanged_at_end_vpos = first_unchanged_at_end_vpos;
  
#endif /* GLYPH_DEBUG != 0 */


  /* Display new lines.  Set last_text_row to the last new line
     displayed which has text on it, i.e. might end up as being the
     line where the window_end_vpos is.  */
  w->cursor.vpos = -1;
  last_text_row = NULL;
  overlay_arrow_seen = 0;
  while (it.current_y < it.last_visible_y
         && !fonts_changed_p
         && (first_unchanged_at_end_row == NULL
             || IT_CHARPOS (it) < stop_pos))
    {
      if (display_line (&it))
        last_text_row = it.glyph_row - 1;
    }

  if (fonts_changed_p)
    return -1;


  /* Compute differences in buffer positions, y-positions etc.  for
     lines reused at the bottom of the window.  Compute what we can
     scroll.  */
  if (first_unchanged_at_end_row)
    {
      dvpos = (it.vpos
               - MATRIX_ROW_VPOS (first_unchanged_at_end_row,
                                  current_matrix));
      dy = it.current_y - first_unchanged_at_end_row->y;
      run.current_y = first_unchanged_at_end_row->y;
      run.desired_y = run.current_y + dy;
      run.height = it.last_visible_y - max (run.current_y, run.desired_y);
    }
  else
    delta = dvpos = dy = run.current_y = run.desired_y = run.height = 0;
  IF_DEBUG (debug_dvpos = dvpos; debug_dy = dy);

  
  /* Find the cursor if not already found.  We have to decide whether
     PT will appear on this window (it sometimes doesn't, but this is
     not a very frequent case.)  This decision has to be made before
     the current matrix is altered.  A value of cursor.vpos < 0 means
     that PT is either in one of the lines beginning at
     first_unchanged_at_end_row or below the window.  Don't care for
     lines that might be displayed later at the window end; as
     mentioned, this is not a frequent case.  */
  if (w->cursor.vpos < 0)
    {
      int last_y = min (it.last_visible_y, it.last_visible_y + dy);

      /* Cursor in unchanged rows at the top?  */
      if (PT < CHARPOS (start_pos)
          && last_unchanged_at_beg_row)
        {
          row = MATRIX_FIRST_TEXT_ROW (w->current_matrix);
          while (row <= last_unchanged_at_beg_row
                 && MATRIX_ROW_END_CHARPOS (row) <= PT)
            ++row;
          xassert (row <= last_unchanged_at_beg_row);
          set_cursor_from_row (w, row, w->current_matrix, 0, 0, 0, 0);
        }

      /* Start from first_unchanged_at_end_row looking for PT.  */
      else if (first_unchanged_at_end_row)
        {
          row = first_unchanged_at_end_row;
          while (MATRIX_ROW_DISPLAYS_TEXT_P (row))
            {
              if (PT - delta >= MATRIX_ROW_START_CHARPOS (row)
                  && PT - delta < MATRIX_ROW_END_CHARPOS (row))
                {
                  set_cursor_from_row (w, row, w->current_matrix, delta,
                                       delta_bytes, dy, dvpos);
                  break;
                }
              else if (MATRIX_ROW_BOTTOM_Y (row) >= last_y)
                break;
              ++row;
            }
        }

      /* Give up if cursor was not found.  */
      if (w->cursor.vpos < 0)
        {
          clear_glyph_matrix (w->desired_matrix);
          return -1;
        }
    }
  
  /* Don't let the cursor end in the scroll margins.  */
  {
    int this_scroll_margin, cursor_height;
    
    this_scroll_margin = max (0, scroll_margin);
    this_scroll_margin = min (this_scroll_margin,
                              XFASTINT (w->height) / 4);
    this_scroll_margin *= CANON_Y_UNIT (it.f);
    cursor_height = MATRIX_ROW (w->desired_matrix, w->cursor.vpos)->height;
    
    if ((w->cursor.y < this_scroll_margin
         && CHARPOS (start) > BEGV)
        /* Don't take scroll margin into account at the bottom because
           old redisplay didn't do it either.  */
        || w->cursor.y + cursor_height > it.last_visible_y)
      {
        w->cursor.vpos = -1;
        clear_glyph_matrix (w->desired_matrix);
        return -1;
      }
  }

  /* Scroll the display.  Do it before changing the current matrix so
     that xterm.c doesn't get confused about where the cursor glyph is
     found.  */
  if (dy)
    {
      update_begin (f);
          
      if (FRAME_WINDOW_P (f))
        {
          rif->update_window_begin_hook (w);
          rif->scroll_run_hook (w, &run);
          rif->update_window_end_hook (w, 0);
        }
      else
        {
          /* Terminal frame.  In this case, dvpos gives the number of
             lines to scroll by; dvpos < 0 means scroll up.  */
          int first_unchanged_at_end_vpos
            = MATRIX_ROW_VPOS (first_unchanged_at_end_row, w->current_matrix);
          int from = XFASTINT (w->top) + first_unchanged_at_end_vpos;
          int end = XFASTINT (w->top) + window_internal_height (w);
          
          /* Perform the operation on the screen.  */
          if (dvpos > 0)
            {
              /* Scroll last_unchanged_at_beg_row to the end of the
                 window down dvpos lines.  */
              set_terminal_window (end);

              /* On dumb terminals delete dvpos lines at the end
                 before inserting dvpos empty lines.  */
              if (!scroll_region_ok)
                ins_del_lines (end - dvpos, -dvpos);

              /* Insert dvpos empty lines in front of
                 last_unchanged_at_beg_row.  */
              ins_del_lines (from, dvpos);
            }
          else if (dvpos < 0)
            {
              /* Scroll up last_unchanged_at_beg_vpos to the end of
                 the window to last_unchanged_at_beg_vpos - |dvpos|.  */
              set_terminal_window (end);

              /* Delete dvpos lines in front of
                 last_unchanged_at_beg_vpos.  ins_del_lines will set
                 the cursor to the given vpos and emit |dvpos| delete
                 line sequences.  */
              ins_del_lines (from + dvpos, dvpos);

              /* On a dumb terminal insert dvpos empty lines at the
                 end.  */
              if (!scroll_region_ok)
                ins_del_lines (end + dvpos, -dvpos);
            }
          
          set_terminal_window (0);
        }
      
      update_end (f);
    }

  /* Shift reused rows of the current matrix to the right position.  */
  if (dvpos < 0)
    {
      rotate_matrix (current_matrix, first_unchanged_at_end_vpos + dvpos,
                     bottom_vpos, dvpos);
      enable_glyph_matrix_rows (current_matrix, bottom_vpos + dvpos,
                                bottom_vpos, 0);
    }
  else if (dvpos > 0)
    {
      rotate_matrix (current_matrix, first_unchanged_at_end_vpos,
                     bottom_vpos, dvpos);
      enable_glyph_matrix_rows (current_matrix, first_unchanged_at_end_vpos,
                                first_unchanged_at_end_vpos + dvpos, 0);
    }

  /* For frame-based redisplay, make sure that current frame and window
     matrix are in sync with respect to glyph memory.  */
  if (!FRAME_WINDOW_P (f))
    sync_frame_with_window_matrix_rows (w);

  /* Adjust buffer positions in reused rows.  */
  if (delta)
    increment_glyph_matrix_buffer_positions (current_matrix,
                                             first_unchanged_at_end_vpos + dvpos,
                                             bottom_vpos, delta, delta_bytes);

  /* Adjust Y positions.  */
  if (dy)
    shift_glyph_matrix (w, current_matrix,
                        first_unchanged_at_end_vpos + dvpos,
                        bottom_vpos, dy);

  if (first_unchanged_at_end_row)
    first_unchanged_at_end_row += dvpos;

  /* If scrolling up, there may be some lines to display at the end of
     the window.  */
  last_text_row_at_end = NULL;
  if (dy < 0)
    {
      /* Set last_row to the glyph row in the current matrix where the
         window end line is found.  It has been moved up or down in
         the matrix by dvpos.  */
      int last_vpos = XFASTINT (w->window_end_vpos) + dvpos;
      struct glyph_row *last_row = MATRIX_ROW (current_matrix, last_vpos);

      /* If last_row is the window end line, it should display text.  */
      xassert (last_row->displays_text_p);

      /* If window end line was partially visible before, begin
         displaying at that line.  Otherwise begin displaying with the
         line following it.  */
      if (MATRIX_ROW_BOTTOM_Y (last_row) - dy >= it.last_visible_y)
        {
          init_to_row_start (&it, w, last_row);
          it.vpos = last_vpos;
          it.current_y = last_row->y;
        }
      else
        {
          init_to_row_end (&it, w, last_row);
          it.vpos = 1 + last_vpos;
          it.current_y = MATRIX_ROW_BOTTOM_Y (last_row);
          ++last_row;
        }

      /* We may start in a continuation line.  If so, we have to get
         the right continuation_lines_width and current_x.  */
      it.continuation_lines_width = last_row->continuation_lines_width;
      it.hpos = it.current_x = 0;
      
      /* Display the rest of the lines at the window end.  */
      it.glyph_row = MATRIX_ROW (desired_matrix, it.vpos);
      while (it.current_y < it.last_visible_y
             && !fonts_changed_p)
        {
          /* Is it always sure that the display agrees with lines in
             the current matrix?  I don't think so, so we mark rows
             displayed invalid in the current matrix by setting their
             enabled_p flag to zero.  */
          MATRIX_ROW (w->current_matrix, it.vpos)->enabled_p = 0;
          if (display_line (&it))
            last_text_row_at_end = it.glyph_row - 1;
        }
    }

  /* Update window_end_pos and window_end_vpos.  */
  if (first_unchanged_at_end_row
      && first_unchanged_at_end_row->y < it.last_visible_y
      && !last_text_row_at_end)
    {
      /* Window end line if one of the preserved rows from the current
         matrix.  Set row to the last row displaying text in current
         matrix starting at first_unchanged_at_end_row, after
         scrolling.  */
      xassert (first_unchanged_at_end_row->displays_text_p);
      row = find_last_row_displaying_text (w->current_matrix, &it,
                                           first_unchanged_at_end_row);
      xassert (row && MATRIX_ROW_DISPLAYS_TEXT_P (row));
      
      XSETFASTINT (w->window_end_pos, Z - MATRIX_ROW_END_CHARPOS (row));
      w->window_end_bytepos = Z_BYTE - MATRIX_ROW_END_BYTEPOS (row);
      XSETFASTINT (w->window_end_vpos,
                   MATRIX_ROW_VPOS (row, w->current_matrix));
    }
  else if (last_text_row_at_end)
    {
      XSETFASTINT (w->window_end_pos,
                   Z - MATRIX_ROW_END_CHARPOS (last_text_row_at_end));
      w->window_end_bytepos
        = Z_BYTE - MATRIX_ROW_END_BYTEPOS (last_text_row_at_end);
      XSETFASTINT (w->window_end_vpos,
                   MATRIX_ROW_VPOS (last_text_row_at_end, desired_matrix));
    }
  else if (last_text_row)
    {
      /* We have displayed either to the end of the window or at the
         end of the window, i.e. the last row with text is to be found
         in the desired matrix.  */
      XSETFASTINT (w->window_end_pos,
                   Z - MATRIX_ROW_END_CHARPOS (last_text_row));
      w->window_end_bytepos
        = Z_BYTE - MATRIX_ROW_END_BYTEPOS (last_text_row);
      XSETFASTINT (w->window_end_vpos,
                   MATRIX_ROW_VPOS (last_text_row, desired_matrix));
    }
  else if (first_unchanged_at_end_row == NULL
           && last_text_row == NULL
           && last_text_row_at_end == NULL)
    {
      /* Displayed to end of window, but no line containing text was
         displayed.  Lines were deleted at the end of the window.  */
      int vpos;
      int top_line_p = WINDOW_WANTS_TOP_LINE_P (w) ? 1 : 0;

      for (vpos = XFASTINT (w->window_end_vpos); vpos > 0; --vpos)
        if ((w->desired_matrix->rows[vpos + top_line_p].enabled_p
             && w->desired_matrix->rows[vpos + top_line_p].displays_text_p)
            || (!w->desired_matrix->rows[vpos + top_line_p].enabled_p
                && w->current_matrix->rows[vpos + top_line_p].displays_text_p))
          break;

      w->window_end_vpos = make_number (vpos);
    }
  else
    abort ();
  
  IF_DEBUG (debug_end_pos = XFASTINT (w->window_end_pos);
            debug_end_vpos = XFASTINT (w->window_end_vpos));

  /* Record that display has not been completed.  */
  w->window_end_valid = Qnil;
  w->desired_matrix->no_scrolling_p = 1;
  return 1;
}


\f
/***********************************************************************
                        More debugging support
 ***********************************************************************/

#if GLYPH_DEBUG

 void dump_glyph_row P_ ((struct glyph_matrix *, int, int));
static void dump_glyph_matrix P_ ((struct glyph_matrix *, int));


/* Dump the contents of glyph matrix MATRIX on stderr.  If
   WITH_GLYPHS_P is non-zero, dump glyph contents as well.  */

void
dump_glyph_matrix (matrix, with_glyphs_p)
     struct glyph_matrix *matrix;
     int with_glyphs_p;
{
  int i;
  for (i = 0; i < matrix->nrows; ++i)
    dump_glyph_row (matrix, i, with_glyphs_p);
}


/* Dump the contents of glyph row at VPOS in MATRIX to stderr.
   WITH_GLYPH_SP non-zero means dump glyph contents, too.  */

void
dump_glyph_row (matrix, vpos, with_glyphs_p)
     struct glyph_matrix *matrix;
     int vpos, with_glyphs_p;
{
  struct glyph_row *row;
  
  if (vpos < 0 || vpos >= matrix->nrows)
    return;

  row = MATRIX_ROW (matrix, vpos);
  
  fprintf (stderr, "Row Start   End Used oEI><O\\CTZF    X   Y   W\n");
  fprintf (stderr, "=============================================\n");
  
  fprintf (stderr, "%3d %5d %5d %4d %1.1d%1.1d%1.1d%1.1d%1.1d%1.1d%1.1d%1.1d%1.1d%1.1d%1.1d %4d %4d %4d\n",
           row - matrix->rows,
           MATRIX_ROW_START_CHARPOS (row),
           MATRIX_ROW_END_CHARPOS (row),
           row->used[TEXT_AREA],
           row->contains_overlapping_glyphs_p,
           row->enabled_p,
           row->inverse_p,
           row->truncated_on_left_p,
           row->truncated_on_right_p,
           row->overlay_arrow_p,
           row->continued_p,
           MATRIX_ROW_CONTINUATION_LINE_P (row),
           row->displays_text_p,
           row->ends_at_zv_p,
           row->fill_line_p,
           row->x,
           row->y,
           row->pixel_width);
  fprintf (stderr, "%9d %5d\n", row->start.overlay_string_index,
           row->end.overlay_string_index);
  fprintf (stderr, "%9d %5d\n",
           CHARPOS (row->start.string_pos),
           CHARPOS (row->end.string_pos));
  fprintf (stderr, "%9d %5d\n", row->start.dpvec_index,
           row->end.dpvec_index);
  
  if (with_glyphs_p)
    {
      struct glyph *glyph, *glyph_end;
      int prev_had_glyphs_p;
      
      glyph = row->glyphs[TEXT_AREA];
      glyph_end = glyph + row->used[TEXT_AREA];
      
      /* Glyph for a line end in text.  */
      if (glyph == glyph_end && glyph->charpos > 0)
        ++glyph_end;
      
      if (glyph < glyph_end)
        {
          fprintf (stderr, "  Glyph    Type Pos   W    Code C Face LR\n");
          prev_had_glyphs_p = 1;
        }
      else
        prev_had_glyphs_p = 0;
      
      while (glyph < glyph_end)
        {
          if (glyph->type == CHAR_GLYPH)
            {
              fprintf (stderr,
                       "  %5d %4c %6d %3d 0x%05x %c %4d %1.1d%1.1d\n",
                       glyph - row->glyphs[TEXT_AREA],
                       'C',
                       glyph->charpos,
                       glyph->pixel_width,
                       glyph->u.ch.code,
                       (glyph->u.ch.code < 0x80 && glyph->u.ch.code >= ' '
                        ? glyph->u.ch.code
                        : '.'),
                       glyph->u.ch.face_id,
                       glyph->left_box_line_p,
                       glyph->right_box_line_p);
            }
          else if (glyph->type == STRETCH_GLYPH)
            {
              fprintf (stderr,
                       "  %5d %4c %6d %3d 0x%05x %c %4d %1.1d%1.1d\n",
                       glyph - row->glyphs[TEXT_AREA],
                       'S',
                       glyph->charpos,
                       glyph->pixel_width,
                       0,
                       '.',
                       glyph->u.stretch.face_id,
                       glyph->left_box_line_p,
                       glyph->right_box_line_p);
            }
          else if (glyph->type == IMAGE_GLYPH)
            {
              fprintf (stderr,
                       "  %5d %4c %6d %3d 0x%05x %c %4d %1.1d%1.1d\n",
                       glyph - row->glyphs[TEXT_AREA],
                       'I',
                       glyph->charpos,
                       glyph->pixel_width,
                       glyph->u.img.id,
                       '.',
                       glyph->u.img.face_id,
                       glyph->left_box_line_p,
                       glyph->right_box_line_p);
            }
          ++glyph;
        }
    }
}


DEFUN ("dump-glyph-matrix", Fdump_glyph_matrix,
       Sdump_glyph_matrix, 0, 1, "p",
  "Dump the current matrix of the selected window to stderr.\n\
Shows contents of glyph row structures.  With non-nil optional\n\
parameter WITH-GLYPHS-P, dump glyphs as well.")
  (with_glyphs_p)
{
  struct window *w = XWINDOW (selected_window);
  struct buffer *buffer = XBUFFER (w->buffer);

  fprintf (stderr, "PT = %d, BEGV = %d. ZV = %d\n",
           BUF_PT (buffer), BUF_BEGV (buffer), BUF_ZV (buffer));
  fprintf (stderr, "Cursor x = %d, y = %d, hpos = %d, vpos = %d\n",
           w->cursor.x, w->cursor.y, w->cursor.hpos, w->cursor.vpos);
  fprintf (stderr, "=============================================\n");
  dump_glyph_matrix (w->current_matrix, !NILP (with_glyphs_p));
  return Qnil;
}


DEFUN ("dump-glyph-row", Fdump_glyph_row, Sdump_glyph_row, 1, 1, "",
  "Dump glyph row ROW to stderr.")
  (row)
     Lisp_Object row;
{
  CHECK_NUMBER (row, 0);
  dump_glyph_row (XWINDOW (selected_window)->current_matrix, XINT (row), 1);
  return Qnil;
}


DEFUN ("dump-toolbar-row", Fdump_toolbar_row, Sdump_toolbar_row,
       0, 0, "", "")
  ()
{
  struct glyph_matrix *m = (XWINDOW (selected_frame->toolbar_window)
                            ->current_matrix);
  dump_glyph_row (m, 0, 1);
  return Qnil;
}


DEFUN ("trace-redisplay-toggle", Ftrace_redisplay_toggle,
       Strace_redisplay_toggle, 0, 0, "",
  "Toggle tracing of redisplay.")
     ()
{
  trace_redisplay_p = !trace_redisplay_p;
  return Qnil;
}
       
        
#endif /* GLYPH_DEBUG */


\f
/***********************************************************************
                     Building Desired Matrix Rows
 ***********************************************************************/

/* Return a temporary glyph row holding the glyphs of an overlay
   arrow.  Only used for non-window-redisplay windows.  */

static struct glyph_row *
get_overlay_arrow_glyph_row (w)
     struct window *w;
{
  struct frame *f = XFRAME (WINDOW_FRAME (w));
  struct buffer *buffer = XBUFFER (w->buffer);
  struct buffer *old = current_buffer;
  unsigned char *arrow_string = XSTRING (Voverlay_arrow_string)->data;
  int arrow_len = XSTRING (Voverlay_arrow_string)->size;
  unsigned char *arrow_end = arrow_string + arrow_len;
  unsigned char *p;
  struct it it;
  int multibyte_p;
  int n_glyphs_before;

  set_buffer_temp (buffer);
  init_iterator (&it, w, -1, -1, &scratch_glyph_row, DEFAULT_FACE_ID);
  it.glyph_row->used[TEXT_AREA] = 0;
  SET_TEXT_POS (it.position, 0, 0);

  multibyte_p = !NILP (buffer->enable_multibyte_characters);
  p = arrow_string;
  while (p < arrow_end)
    {
      Lisp_Object face, ilisp;
      
      /* Get the next character.  */
      if (multibyte_p)
        it.c = string_char_and_length (p, arrow_len, &it.len);
      else
        it.c = *p, it.len = 1;
      p += it.len;
      
      /* Get its face.  */
      XSETFASTINT (ilisp, p - arrow_string);
      face = Fget_text_property (ilisp, Qface, Voverlay_arrow_string);
      it.face_id = compute_char_face (f, it.c, face);

      /* Compute its width, get its glyphs.  */
      n_glyphs_before = it.glyph_row->used[TEXT_AREA];
      PRODUCE_GLYPHS (&it);

      /* If this character doesn't fit any more in the line, we have
         to remove some glyphs.  */
      if (it.current_x > it.last_visible_x)
        {
          it.glyph_row->used[TEXT_AREA] = n_glyphs_before;
          break;
        }
    }
  
  set_buffer_temp (old);
  return it.glyph_row;
}


/* Insert truncation glyphs at the start of IT->glyph_row.  Truncation
   glyphs are only inserted for terminal frames since we can't really
   win with truncation glyphs when partially visible glyphs are
   involved.  Which glyphs to insert is determined by
   produce_special_glyphs.  */

static void
insert_left_trunc_glyphs (it)
     struct it *it;
{
  struct it truncate_it;
  struct glyph *from, *end, *to, *toend;

  xassert (!FRAME_WINDOW_P (it->f));

  /* Get the truncation glyphs.  */
  truncate_it = *it;
  truncate_it.charset = -1;
  truncate_it.current_x = 0;
  truncate_it.face_id = DEFAULT_FACE_ID;
  truncate_it.glyph_row = &scratch_glyph_row;
  truncate_it.glyph_row->used[TEXT_AREA] = 0;
  CHARPOS (truncate_it.position) = BYTEPOS (truncate_it.position) = -1;
  truncate_it.object = 0;
  produce_special_glyphs (&truncate_it, IT_TRUNCATION);
  
  /* Overwrite glyphs from IT with truncation glyphs.  */
  from = truncate_it.glyph_row->glyphs[TEXT_AREA];
  end = from + truncate_it.glyph_row->used[TEXT_AREA];
  to = it->glyph_row->glyphs[TEXT_AREA];
  toend = to + it->glyph_row->used[TEXT_AREA];

  while (from < end)
    *to++ = *from++;

  /* There may be padding glyphs left over.  Remove them.  */
  from = to;
  while (from < toend && CHAR_GLYPH_PADDING_P (*from))
    ++from;
  while (from < toend)
    *to++ = *from++;

  it->glyph_row->used[TEXT_AREA] = to - it->glyph_row->glyphs[TEXT_AREA];
}


/* Compute the pixel height and width of IT->glyph_row.

   Most of the time, ascent and height of a display line will be equal
   to the max_ascent and max_height values of the display iterator
   structure.  This is not the case if

   1. We hit ZV without displaying anything.  In this case, max_ascent
   and max_height will be zero.

   2. We have some glyphs that don't contribute to the line height.
   (The glyph row flag contributes_to_line_height_p is for future
   pixmap extensions).

   The first case is easily covered by using default values because in
   these cases, the line height does not really matter, except that it
   must not be zero.  */

static void
compute_line_metrics (it)
     struct it *it;
{
  struct glyph_row *row = it->glyph_row;
  int area, i;

  if (FRAME_WINDOW_P (it->f))
    {
      int i, top_line_height;

      /* The line may consist of one space only, that was added to
         place the cursor on it.  If so, the row's height hasn't been
         computed yet.  */
      if (row->height == 0)
        {
          if (it->max_ascent + it->max_descent == 0)
            it->max_descent = CANON_Y_UNIT (it->f);
          row->ascent = it->max_ascent;
          row->height = it->max_ascent + it->max_descent;
        }
      
      /* Compute the width of this line.  */
      row->pixel_width = row->x;
      for (i = 0; i < row->used[TEXT_AREA]; ++i)
        row->pixel_width += row->glyphs[TEXT_AREA][i].pixel_width;

      xassert (row->pixel_width >= 0);
      xassert (row->ascent >= 0 && row->height > 0);

      /* Compute how much of the line is visible.  */
      row->visible_height = row->height;
      
      top_line_height = WINDOW_DISPLAY_TOP_LINE_HEIGHT (it->w);
      if (row->y < top_line_height)
        row->visible_height -= top_line_height - row->y;
      else
        {
          int max_y = WINDOW_DISPLAY_HEIGHT_NO_MODE_LINE (it->w);
          if (row->y + row->height > max_y)
            row->visible_height -= row->y + row->height - max_y;
        }
    }
  else
    {
      row->pixel_width = row->used[TEXT_AREA];
      row->ascent = 0;
      row->height = row->visible_height = 1;
    }

  /* Compute a hash code for this row.  */
  row->hash = 0;
  for (area = LEFT_MARGIN_AREA; area < LAST_AREA; ++area)
    for (i = 0; i < row->used[area]; ++i)
      row->hash = ((((row->hash << 4) + (row->hash >> 24)) & 0x0fffffff)
                   + row->glyphs[area][i].u.val
                   + (row->glyphs[area][i].type << 2));

  it->max_ascent = it->max_descent = 0;
}


/* Append one space to the glyph row of iterator IT if doing a
   window-based redisplay.  DEFAULT_FACE_P non-zero means let the
   space have the default face, otherwise let it have the same face as
   IT->face_id.  This function is called to make sure that there is
   always one glyph at the end of a glyph row that the cursor can be
   set on under window-systems.  (If there weren't such a glyph we
   would not know how wide and tall the cursor should be displayed).  */

static void
append_space (it, default_face_p)
     struct it *it;
     int default_face_p;
{
  if (FRAME_WINDOW_P (it->f))
    {
      int n = it->glyph_row->used[TEXT_AREA];

      if (it->glyph_row->glyphs[TEXT_AREA] + n
          < it->glyph_row->glyphs[1 + TEXT_AREA])
        {
          /* Save some values that must not be changed.  */
          int saved_x = it->current_x;
          struct text_pos saved_pos;
          int saved_what = it->what;
          int saved_face_id = it->face_id;
          int saved_charset = it->charset;
          Lisp_Object saved_object;

          saved_object = it->object;
          saved_pos = it->position;
          
          it->what = IT_CHARACTER;
          bzero (&it->position, sizeof it->position);
          it->object = 0;
          it->c = ' ';
          it->len = 1;
          it->charset = CHARSET_ASCII;

          if (default_face_p)
            it->face_id = DEFAULT_FACE_ID;
          if (it->multibyte_p)
            it->face_id = FACE_FOR_CHARSET (it->f, it->face_id, CHARSET_ASCII);
          else
            it->face_id = FACE_FOR_CHARSET (it->f, it->face_id, -1);

          PRODUCE_GLYPHS (it);
          
          it->current_x = saved_x;
          it->object = saved_object;
          it->position = saved_pos;
          it->what = saved_what;
          it->face_id = saved_face_id;
          it->charset = saved_charset;
        }
    }
}


/* Extend the face of the last glyph in the text area of IT->glyph_row
   to the end of the display line.  Called from display_line.
   If the glyph row is empty, add a space glyph to it so that we
   know the face to draw.  Set the glyph row flag fill_line_p.  */
   
static void
extend_face_to_end_of_line (it)
     struct it *it;
{
  struct face *face;
  struct frame *f = it->f;

  /* If line is already filled, do nothing.  */
  if (it->current_x >= it->last_visible_x)
    return;
  
  /* Face extension extends the background and box of IT->face_id
     to the end of the line.  If the background equals the background
     of the frame, we haven't to do anything.  */
  face = FACE_FROM_ID (f, it->face_id);
  if (FRAME_WINDOW_P (f)
      && face->box == FACE_NO_BOX
      && face->background == FRAME_BACKGROUND_PIXEL (f)
      && !face->stipple)
    return;

  /* Set the glyph row flag indicating that the face of the last glyph
     in the text area has to be drawn to the end of the text area.  */
  it->glyph_row->fill_line_p = 1;

  /* If current charset of IT is not ASCII, make sure we have the
     ASCII face.  This will be automatically undone the next time
     get_next_display_element returns a character from a different
     charset.  Note that the charset will always be ASCII in unibyte
     text.  */
  if (it->charset != CHARSET_ASCII)
    {
      it->charset = CHARSET_ASCII;
      it->face_id = FACE_FOR_CHARSET (f, it->face_id, CHARSET_ASCII);
    }

  if (FRAME_WINDOW_P (f))
    {
      /* If the row is empty, add a space with the current face of IT,
         so that we know which face to draw.  */
      if (it->glyph_row->used[TEXT_AREA] == 0)
        {
          it->glyph_row->glyphs[TEXT_AREA][0] = space_glyph;
          it->glyph_row->glyphs[TEXT_AREA][0].u.ch.face_id = it->face_id;
          it->glyph_row->used[TEXT_AREA] = 1;
        }
    }
  else
    {
      /* Save some values that must not be changed.  */
      int saved_x = it->current_x;
      struct text_pos saved_pos;
      Lisp_Object saved_object;
      int saved_what = it->what;

      saved_object = it->object;
      saved_pos = it->position;
  
      it->what = IT_CHARACTER;
      bzero (&it->position, sizeof it->position);
      it->object = 0;
      it->c = ' ';
      it->len = 1;
      
      PRODUCE_GLYPHS (it);
      
      while (it->current_x <= it->last_visible_x)
        PRODUCE_GLYPHS (it);
      
      /* Don't count these blanks really.  It would let us insert a left
         truncation glyph below and make us set the cursor on them, maybe.  */
      it->current_x = saved_x;
      it->object = saved_object;
      it->position = saved_pos;
      it->what = saved_what;
    }
}


/* Value is non-zero if text starting at CHARPOS in current_buffer is
   trailing whitespace.  */

static int
trailing_whitespace_p (charpos)
     int charpos;
{
  int bytepos = CHAR_TO_BYTE (charpos);
  int c = 0;

  while (bytepos < ZV_BYTE
         && (c = FETCH_CHAR (bytepos),
             c == ' ' || c == '\t'))
    ++bytepos;

  return bytepos >= ZV_BYTE || c == '\n' || c == '\r';
}


/* Highlight trailing whitespace, if any, in ROW.  */

void
highlight_trailing_whitespace (f, row)
     struct frame *f;
     struct glyph_row *row;
{
  int used = row->used[TEXT_AREA];
  
  if (used)
    {
      struct glyph *start = row->glyphs[TEXT_AREA];
      struct glyph *glyph = start + used - 1;

      /* Skip over the space glyph inserted to display the
         cursor at the end of a line.  */
      if (glyph->type == CHAR_GLYPH
          && glyph->u.ch.code == ' '
          && glyph->object == 0)
        --glyph;

      /* If last glyph is a space or stretch, and it's trailing
         whitespace, set the face of all trailing whitespace glyphs in
         IT->glyph_row to `trailing-whitespace'.  */
      if (glyph >= start
          && BUFFERP (glyph->object)
          && (glyph->type == STRETCH_GLYPH
              || (glyph->type == CHAR_GLYPH
                  && glyph->u.ch.code == ' '))
          && trailing_whitespace_p (glyph->charpos))
        {
          int face_id = lookup_named_face (f, Qtrailing_whitespace,
                                           CHARSET_ASCII);
          
          while (glyph >= start
                 && BUFFERP (glyph->object)
                 && (glyph->type == STRETCH_GLYPH
                     || (glyph->type == CHAR_GLYPH
                         && glyph->u.ch.code == ' ')))
            {
              if (glyph->type == STRETCH_GLYPH)
                glyph->u.stretch.face_id = face_id;
              else
                glyph->u.ch.face_id = face_id;
              --glyph;
            }
        }
    }
}



/* Construct the glyph row IT->glyph_row in the desired matrix of
   IT->w from text at the current position of IT.  See dispextern.h
   for an overview of struct it.  Value is non-zero if
   IT->glyph_row displays text, as opposed to a line displaying ZV
   only.  */
   
static int
display_line (it)
     struct it *it;
{
  struct glyph_row *row = it->glyph_row;

  /* We always start displaying at hpos zero even if hscrolled.  */
  xassert (it->hpos == 0 && it->current_x == 0);

  /* We must not display in a row that's not a text row.  */
  xassert (MATRIX_ROW_VPOS (row, it->w->desired_matrix)
           < it->w->desired_matrix->nrows);

  /* Is IT->w showing the region?  */
  it->w->region_showing = it->region_beg_charpos > 0 ? Qt : Qnil;

  /* Clear the result glyph row and enable it.  */
  prepare_desired_row (row);

  row->y = it->current_y;
  row->start = it->current;
  row->continuation_lines_width = it->continuation_lines_width;
  row->displays_text_p = 1;

  /* Arrange the overlays nicely for our purposes.  Usually, we call
     display_line on only one line at a time, in which case this
     can't really hurt too much, or we call it on lines which appear
     one after another in the buffer, in which case all calls to
     recenter_overlay_lists but the first will be pretty cheap.  */
  recenter_overlay_lists (current_buffer, IT_CHARPOS (*it));

#if NO_PROMPT_IN_BUFFER
  /* Show mini-buffer prompt, if at the beginning of a mini-buffer
     window.  */
  if (MINI_WINDOW_P (it->w) 
      && MATRIX_ROW_START_CHARPOS (row) == BEG 
      && it->vpos == 0)
    {
      if (NILP (minibuf_prompt))
        minibuf_prompt_width = minibuf_prompt_pixel_width = 0;
      else
        {
          /* We would like to truncate the prompt a little bit before
             the right margin of the window, so that user input can
             start on the first line.  Set max_x to this position.  */
          int max_x = (it->last_visible_x - 4 * CANON_X_UNIT (it->f));

          /* We use a temporary iterator different from IT so that
             IT's settings are not overwritten when displaying
             the prompt.  */
          struct it ti;

          ti = *it;

          /* Display the prompt.  Set minibuf_prompt_width to the 
             number of glyphs generated for the prompt, set
             minibuf_prompt_pixel_width to its width in pixels.  */
          xassert (it->current_x == 0);
          display_string (NULL, minibuf_prompt, Qnil, 0, 0, &ti,
                          0, 0, max_x, -1);
          minibuf_prompt_width = ti.hpos;
          minibuf_prompt_pixel_width = ti.current_x;

          /* Transfer pixel and hpos information to IT.  */
          it->hpos = ti.hpos;
          it->current_x = ti.current_x;
        }
    }
#endif /* NO_PROMPT_IN_BUFFER */

  /* Move over display elements that are not visible because we are
     hscrolled.  This may stop at an x-position < IT->first_visible_x
     if the first glyph is partially visible or if we hit a line end.  */
  if (it->current_x < it->first_visible_x)
    move_it_in_display_line_to (it, ZV, it->first_visible_x,
                                MOVE_TO_POS | MOVE_TO_X);

  /* Get the initial row height.  This is either the height of the
     text hscrolled, if there is any, or zero.  */
  row->ascent = it->max_ascent;
  row->height = it->max_ascent + it->max_descent;

  /* Loop generating characters.  The loop is left with IT on the next
     character to display.  */
  while (1)
    {
      int n_glyphs_before, hpos_before, x_before;
      int x, i, nglyphs;
      
      /* Retrieve the next thing to display.  Value is zero if end of
         buffer reached.  */
      if (!get_next_display_element (it))
        {
          /* Maybe add a space at the end of this line that is used to
             display the cursor there under X.  */
          append_space (it, 1);

          /* The position -1 below indicates a blank line not
             corresponding to any text, as opposed to an empty line
             corresponding to a line end.  */
          if (row->used[TEXT_AREA] <= 1)
            {
              row->glyphs[TEXT_AREA]->charpos = -1;
              row->displays_text_p = 0;

              if (!NILP (XBUFFER (it->w->buffer)->indicate_empty_lines))
                row->indicate_empty_line_p = 1;
            }
          
          it->continuation_lines_width = 0;
          row->ends_at_zv_p = 1;
          break;
        }

      /* Now, get the metrics of what we want to display.  This also
         generates glyphs in `row' (which is IT->glyph_row).  */
      n_glyphs_before = row->used[TEXT_AREA];
      x = it->current_x;
      PRODUCE_GLYPHS (it);

      /* If this display element was in marginal areas, continue with
         the next one.  */
      if (it->area != TEXT_AREA)
        {
          row->ascent = max (row->ascent, it->max_ascent);
          row->height = max (row->height, it->max_ascent + it->max_descent);
          set_iterator_to_next (it);
          continue;
        }

      /* Does the display element fit on the line?  If we truncate
         lines, we should draw past the right edge of the window.  If
         we don't truncate, we want to stop so that we can display the
         continuation glyph before the right margin.  If lines are
         continued, there are two possible strategies for characters
         resulting in more than 1 glyph (e.g. tabs): Display as many
         glyphs as possible in this line and leave the rest for the
         continuation line, or display the whole element in the next
         line.  Original redisplay did the former, so we do it also.  */
      nglyphs = row->used[TEXT_AREA] - n_glyphs_before;
      hpos_before = it->hpos;
      x_before = x;
          
      if (nglyphs == 1
          && it->current_x < it->last_visible_x)
        {
          ++it->hpos;
          row->ascent = max (row->ascent, it->max_ascent);
          row->height = max (row->height, it->max_ascent + it->max_descent);
          if (it->current_x - it->pixel_width < it->first_visible_x)
            row->x = x - it->first_visible_x;
        }
      else
        {
          int new_x;
          struct glyph *glyph;
          
          for (i = 0; i < nglyphs; ++i, x = new_x)
            {
              glyph = row->glyphs[TEXT_AREA] + n_glyphs_before + i;
              new_x = x + glyph->pixel_width;

              if (/* Lines are continued.  */
                  !it->truncate_lines_p
                  && (/* Glyph doesn't fit on the line.  */
                      new_x > it->last_visible_x
                      /* Or it fits exactly on a window system frame.  */
                      || (new_x == it->last_visible_x
                          && FRAME_WINDOW_P (it->f))))
                {
                  /* End of a continued line.  */
                  
                  if (it->hpos == 0
                      || (new_x == it->last_visible_x
                          && FRAME_WINDOW_P (it->f)))
                    {
                      /* Current glyph fits exactly on the line.  We
                         must continue the line because we can't draw
                         the cursor after the glyph.  */
                      row->continued_p = 1;
                      it->current_x = new_x;
                      it->continuation_lines_width += new_x;
                      ++it->hpos;
                      if (i == nglyphs - 1)
                        set_iterator_to_next (it);
                    }
                  else
                    {
                      /* Display element draws past the right edge of
                         the window.  Restore positions to values
                         before the element.  The next line starts
                         with current_x before the glyph that could
                         not be displayed, so that TAB works right.  */
                      row->used[TEXT_AREA] = n_glyphs_before + i;
                  
                      /* Display continuation glyphs.  */
                      if (!FRAME_WINDOW_P (it->f))
                        produce_special_glyphs (it, IT_CONTINUATION);
                      row->continued_p = 1;
                      
                      it->current_x = x;
                      it->continuation_lines_width += x;
                    }
                  break;
                }
              else if (new_x > it->first_visible_x)
                {
                  /* Increment number of glyphs actually displayed.  */
                  ++it->hpos;
                  
                  if (x < it->first_visible_x)
                    /* Glyph is partially visible, i.e. row starts at
                       negative X position.  */
                    row->x = x - it->first_visible_x;
                }
              else
                {
                  /* Glyph is completely off the left margin of the
                     window.  This should not happen because of the
                     move_it_in_display_line at the start of
                     this function.  */
                  abort ();
                }
            }
          
          row->ascent = max (row->ascent, it->max_ascent);
          row->height = max (row->height, it->max_ascent + it->max_descent);
          
          /* End of this display line if row is continued.  */
          if (row->continued_p)
            break;
        }

      /* Is this a line end?  If yes, we're also done, after making
         sure that a non-default face is extended up to the right
         margin of the window.  */
      if (ITERATOR_AT_END_OF_LINE_P (it))
        {
          int used_before = row->used[TEXT_AREA];

          /* Add a space at the end of the line that is used to
             display the cursor there.  */
          append_space (it, 0);
          
          /* Extend the face to the end of the line.  */
          extend_face_to_end_of_line (it);

          /* Make sure we have the position.  */
          if (used_before == 0)
            row->glyphs[TEXT_AREA]->charpos = CHARPOS (it->position);
          
          /* Consume the line end.  This skips over invisible lines.  */
          set_iterator_to_next (it);
          it->continuation_lines_width = 0;
          break;
        }

      /* Proceed with next display element.  Note that this skips 
         over lines invisible because of selective display.  */
      set_iterator_to_next (it);

      /* If we truncate lines, we are done when the last displayed
         glyphs reach past the right margin of the window.  */
      if (it->truncate_lines_p
          && (FRAME_WINDOW_P (it->f)
              ? (it->current_x >= it->last_visible_x)
              : (it->current_x > it->last_visible_x)))
        {
          /* Maybe add truncation glyphs.  */
          if (!FRAME_WINDOW_P (it->f))
            {
              --it->glyph_row->used[TEXT_AREA];
              produce_special_glyphs (it, IT_TRUNCATION);
            }
          
          row->truncated_on_right_p = 1;
          it->continuation_lines_width = 0;
          reseat_at_next_visible_line_start (it);
          row->ends_at_zv_p = FETCH_BYTE (IT_BYTEPOS (*it) - 1) != '\n';
          it->hpos = hpos_before;
          it->current_x = x_before;
          break;
        }
    }

  /* If line is not empty and hscrolled, maybe insert truncation glyphs
     at the left window margin.  */
  if (it->first_visible_x
      && IT_CHARPOS (*it) != MATRIX_ROW_START_CHARPOS (row))
    {
      if (!FRAME_WINDOW_P (it->f))
        insert_left_trunc_glyphs (it);
      row->truncated_on_left_p = 1;
    }

  /* If the start of this line is the overlay arrow-position, then
     mark this glyph row as the one containing the overlay arrow.
     This is clearly a mess with variable size fonts.  It would be
     better to let it be displayed like cursors under X.  */
  if (MARKERP (Voverlay_arrow_position)
      && current_buffer == XMARKER (Voverlay_arrow_position)->buffer
      && (MATRIX_ROW_START_CHARPOS (row)
          == marker_position (Voverlay_arrow_position))
      && STRINGP (Voverlay_arrow_string)
      && ! overlay_arrow_seen)
    {
      /* Overlay arrow in window redisplay is a bitmap.  */
      if (!FRAME_WINDOW_P (it->f))
        {
          struct glyph_row *arrow_row = get_overlay_arrow_glyph_row (it->w);
          struct glyph *glyph = arrow_row->glyphs[TEXT_AREA];
          struct glyph *arrow_end = glyph + arrow_row->used[TEXT_AREA];
          struct glyph *p = row->glyphs[TEXT_AREA];
          struct glyph *p2, *end;

          /* Copy the arrow glyphs.  */
          while (glyph < arrow_end)
            *p++ = *glyph++;

          /* Throw away padding glyphs.  */
          p2 = p;
          end = row->glyphs[TEXT_AREA] + row->used[TEXT_AREA];
          while (p2 < end && CHAR_GLYPH_PADDING_P (*p2))
            ++p2;
          if (p2 > p)
            {
              while (p2 < end)
                *p++ = *p2++;
              row->used[TEXT_AREA] = p2 - row->glyphs[TEXT_AREA];
            }
        }
      
      overlay_arrow_seen = 1;
      row->overlay_arrow_p = 1;
    }

  /* Compute pixel dimensions of this line.  */
  compute_line_metrics (it);

  /* Remember the position at which this line ends.  */
  row->end = it->current;

  /* Maybe set the cursor.  If you change this, it's probably a good
     idea to also change the code in redisplay_window for cursor
     movement in an unchanged window.  */
  if (it->w->cursor.vpos < 0
      && PT >= MATRIX_ROW_START_CHARPOS (row)
      && MATRIX_ROW_END_CHARPOS (row) >= PT
      && !(MATRIX_ROW_END_CHARPOS (row) == PT
           && (MATRIX_ROW_ENDS_IN_MIDDLE_OF_CHAR_P (row)
               || !row->ends_at_zv_p)))
    set_cursor_from_row (it->w, row, it->w->desired_matrix, 0, 0, 0, 0);

  /* Highlight trailing whitespace.  */
  if (it->show_trailing_whitespace_p)
    highlight_trailing_whitespace (it->f, it->glyph_row);

  /* Prepare for the next line.  This line starts horizontally at (X
     HPOS) = (0 0).  Vertical positions are incremented.  As a
     convenience for the caller, IT->glyph_row is set to the next
     row to be used.  */
  it->current_x = it->hpos = 0;
  it->current_y += row->height;
  ++it->vpos;
  ++it->glyph_row;
  return row->displays_text_p;
}


\f
/***********************************************************************
                               Menu Bar
 ***********************************************************************/

/* Redisplay the menu bar in the frame for window W.

   The menu bar of X frames that don't have X toolkit support is
   displayed in a special window W->frame->menu_bar_window.
   
   The menu bar of terminal frames is treated specially as far as
   glyph matrices are concerned.  Menu bar lines are not part of
   windows, so the update is done directly on the frame matrix rows
   for the menu bar.  */

static void
display_menu_bar (w)
     struct window *w;
{
  struct frame *f = XFRAME (WINDOW_FRAME (w));
  struct it it;
  Lisp_Object items;
  int i;

  /* Don't do all this for graphical frames.  */
#ifdef HAVE_NTGUI
  if (!NILP (Vwindow_system))
    return;
#endif
#ifdef USE_X_TOOLKIT
  if (FRAME_X_P (f))
    return;
#endif

#ifdef USE_X_TOOLKIT
  xassert (!FRAME_WINDOW_P (f));
  init_iterator (&it, w, -1, -1, f->desired_matrix->rows, MODE_LINE_FACE_ID);
  it.first_visible_x = 0;
  it.last_visible_x = FRAME_WINDOW_WIDTH (f) * CANON_X_UNIT (f);
#else /* not USE_X_TOOLKIT */
  if (FRAME_WINDOW_P (f))
    {
      /* Menu bar lines are displayed in the desired matrix of the
         dummy window menu_bar_window.  */
      struct window *menu_w;
      xassert (WINDOWP (f->menu_bar_window));
      menu_w = XWINDOW (f->menu_bar_window);
      init_iterator (&it, menu_w, -1, -1, menu_w->desired_matrix->rows,
                     MODE_LINE_FACE_ID);
      it.first_visible_x = 0;
      it.last_visible_x = FRAME_WINDOW_WIDTH (f) * CANON_X_UNIT (f);
    }
  else
    {
      /* This is a TTY frame, i.e. character hpos/vpos are used as
         pixel x/y.  */
      init_iterator (&it, w, -1, -1, f->desired_matrix->rows,
                     MODE_LINE_FACE_ID);
      it.first_visible_x = 0;
      it.last_visible_x = FRAME_WIDTH (f);
    }
#endif /* not USE_X_TOOLKIT */

  /* Clear all rows of the menu bar.  */
  for (i = 0; i < FRAME_MENU_BAR_LINES (f); ++i)
    {
      struct glyph_row *row = it.glyph_row + i;
      clear_glyph_row (row);
      row->enabled_p = 1;
      row->full_width_p = 1;
    }

  /* Make the first line of the menu bar appear in reverse video.  */
  it.glyph_row->inverse_p = mode_line_inverse_video != 0;

  /* Display all items of the menu bar.  */
  items = FRAME_MENU_BAR_ITEMS (it.f);
  for (i = 0; i < XVECTOR (items)->size; i += 4)
    {
      Lisp_Object string;

      /* Stop at nil string.  */
      string = XVECTOR (items)->contents[i + 1];
      if (NILP (string))
        break;

      /* Remember where item was displayed.  */
      XSETFASTINT (XVECTOR (items)->contents[i + 3], it.hpos);

      /* Display the item, pad with one space.  */
      if (it.current_x < it.last_visible_x)
        display_string (NULL, string, Qnil, 0, 0, &it,
                        XSTRING (string)->size + 1, 0, 0, -1);
    }

  /* Fill out the line with spaces.  */
  if (it.current_x < it.last_visible_x)
    display_string ("", Qnil, Qnil, 0, 0, &it, -1, 0, 0, -1);

  /* Compute the total height of the lines.  */
  compute_line_metrics (&it);
}


\f
/***********************************************************************
                              Mode Line
 ***********************************************************************/

/* Display the mode and/or top line of window W.  */

static void
display_mode_lines (w)
     struct window *w;
{
  /* These will be set while the mode line specs are processed.  */
  line_number_displayed = 0;
  w->column_number_displayed = Qnil;

  if (WINDOW_WANTS_MODELINE_P (w))
    display_mode_line (w, MODE_LINE_FACE_ID, current_buffer->mode_line_format);
  
  if (WINDOW_WANTS_TOP_LINE_P (w))
    display_mode_line (w, TOP_LINE_FACE_ID, current_buffer->top_line_format);
}


/* Display mode or top line of window W.  FACE_ID specifies which line
   to display; it is either MODE_LINE_FACE_ID or TOP_LINE_FACE_ID.
   FORMAT is the mode line format to display.  */

static void
display_mode_line (w, face_id, format)
     struct window *w;
     enum face_id face_id;
     Lisp_Object format;
{
  struct it it;
  struct face *face;

  init_iterator (&it, w, -1, -1, NULL, face_id);
  prepare_desired_row (it.glyph_row);

  /* Temporarily make frame's keyboard the current kboard so that
     kboard-local variables in the mode_line_format will get the right
     values.  */
  push_frame_kboard (it.f);
  display_mode_element (&it, 0, 0, 0, format);
  pop_frame_kboard ();

  /* Fill up with spaces.  */
  display_string (" ", Qnil, Qnil, 0, 0, &it, 10000, -1, -1, 0);
  
  compute_line_metrics (&it);
  it.glyph_row->full_width_p = 1;
  it.glyph_row->mode_line_p = 1;
  it.glyph_row->inverse_p = mode_line_inverse_video != 0;
  it.glyph_row->continued_p = 0;
  it.glyph_row->truncated_on_left_p = 0;
  it.glyph_row->truncated_on_right_p = 0;

  /* Make a 3D mode-line have a shadow at its right end.  */
  face = FACE_FROM_ID (it.f, face_id);
  extend_face_to_end_of_line (&it);
  if (face->box != FACE_NO_BOX)
    {
      struct glyph *last = (it.glyph_row->glyphs[TEXT_AREA]
                            + it.glyph_row->used[TEXT_AREA] - 1);
      last->right_box_line_p = 1;
    }
}


/* Contribute ELT to the mode line for window IT->w.  How it
   translates into text depends on its data type.

   IT describes the display environment in which we display, as usual.

   DEPTH is the depth in recursion.  It is used to prevent
   infinite recursion here.

   FIELD_WIDTH is the number of characters the display of ELT should
   occupy in the mode line, and PRECISION is the maximum number of
   characters to display from ELT's representation.  See
   display_string for details.  *

   Returns the hpos of the end of the text generated by ELT.  */

static int
display_mode_element (it, depth, field_width, precision, elt)
     struct it *it;
     int depth;
     int field_width, precision;
     Lisp_Object elt;
{
  int n = 0, field, prec;

 tail_recurse:
  if (depth > 10)
    goto invalid;

  depth++;

  switch (SWITCH_ENUM_CAST (XTYPE (elt)))
    {
    case Lisp_String:
      {
        /* A string: output it and check for %-constructs within it.  */
        unsigned char c;
        unsigned char *this = XSTRING (elt)->data;
        unsigned char *lisp_string = this;

        while ((precision <= 0 || n < precision)
               && *this
               && (frame_title_ptr
                   || it->current_x < it->last_visible_x))
          {
            unsigned char *last = this;

            /* Advance to end of string or next format specifier.  */
            while ((c = *this++) != '\0' && c != '%')
              ;
            
            if (this - 1 != last)
              {
                /* Output to end of string or up to '%'.  Field width
                   is length of string.  Don't output more than
                   PRECISION allows us.  */
                prec = --this - last;
                if (precision > 0 && prec > precision - n)
                  prec = precision - n;
                
                if (frame_title_ptr)
                  n += store_frame_title (last, prec, prec);
                else
                  n += display_string (NULL, elt, Qnil, 0, last - lisp_string,
                                       it, 0, prec, 0, -1);
              }
            else /* c == '%' */
              {
                unsigned char *percent_position = this;
                
                /* Get the specified minimum width.  Zero means
                   don't pad.  */
                field = 0;
                while ((c = *this++) >= '0' && c <= '9')
                  field = field * 10 + c - '0';

                /* Don't pad beyond the total padding allowed.  */
                if (field_width - n > 0 && field > field_width - n)
                  field = field_width - n;

                /* Note that either PRECISION <= 0 or N < PRECISION.  */
                prec = precision - n;
                
                if (c == 'M')
                  n += display_mode_element (it, depth, field, prec,
                                             Vglobal_mode_string);
                else if (c != 0)
                  {
                    unsigned char *spec
                      = decode_mode_spec (it->w, c, field, prec);
                    
                    if (frame_title_ptr)
                      n += store_frame_title (spec, field, prec);
                    else
                      {
                        int nglyphs_before
                          = it->glyph_row->used[TEXT_AREA];
                        int charpos
                          = percent_position - XSTRING (elt)->data;
                        int nwritten
                          = display_string (spec, Qnil, elt, charpos, 0, it,
                                            field, prec, 0, -1);

                        /* Assign to the glyphs written above the
                           string where the `%x' came from, position
                           of the `%'.  */
                        if (nwritten > 0)
                          {
                            struct glyph *glyph
                              = (it->glyph_row->glyphs[TEXT_AREA]
                                 + nglyphs_before);
                            int i;

                            for (i = 0; i < nwritten; ++i)
                              {
                                glyph[i].object = elt;
                                glyph[i].charpos = charpos;
                              }
                            
                            n += nwritten;
                          }
                      }
                  }
              }
          }
      }
      break;

    case Lisp_Symbol:
      /* A symbol: process the value of the symbol recursively
         as if it appeared here directly.  Avoid error if symbol void.
         Special case: if value of symbol is a string, output the string
         literally.  */
      {
        register Lisp_Object tem;
        tem = Fboundp (elt);
        if (!NILP (tem))
          {
            tem = Fsymbol_value (elt);
            /* If value is a string, output that string literally:
               don't check for % within it.  */
            if (STRINGP (tem))
              {
                prec = XSTRING (tem)->size;
                if (precision > 0 && prec > precision - n)
                  prec = precision - n;
                if (frame_title_ptr)
                  n += store_frame_title (XSTRING (tem)->data, -1, prec);
                else
                  n += display_string (NULL, tem, Qnil, 0, 0, it,
                                       0, prec, 0, -1);
              }
            else if (!EQ (tem, elt))
              {
                /* Give up right away for nil or t.  */
                elt = tem;
                goto tail_recurse;
              }
          }
      }
      break;

    case Lisp_Cons:
      {
        register Lisp_Object car, tem;

        /* A cons cell: three distinct cases.
           If first element is a string or a cons, process all the elements
           and effectively concatenate them.
           If first element is a negative number, truncate displaying cdr to
           at most that many characters.  If positive, pad (with spaces)
           to at least that many characters.
           If first element is a symbol, process the cadr or caddr recursively
           according to whether the symbol's value is non-nil or nil.  */
        car = XCONS (elt)->car;
        if (EQ (car, QCeval) && CONSP (XCDR (elt)))
          {
            /* An element of the form (:eval FORM) means evaluate FORM
               and use the result as mode line elements.  */
            struct gcpro gcpro1;
            Lisp_Object spec;

            spec = eval_form (XCAR (XCDR (elt)));
            GCPRO1 (spec);
            n += display_mode_element (it, depth, field_width - n,
                                       precision - n, spec);
            UNGCPRO;
          }
        else if (SYMBOLP (car))
          {
            tem = Fboundp (car);
            elt = XCONS (elt)->cdr;
            if (!CONSP (elt))
              goto invalid;
            /* elt is now the cdr, and we know it is a cons cell.
               Use its car if CAR has a non-nil value.  */
            if (!NILP (tem))
              {
                tem = Fsymbol_value (car);
                if (!NILP (tem))
                  { elt = XCONS (elt)->car; goto tail_recurse; }
              }
            /* Symbol's value is nil (or symbol is unbound)
               Get the cddr of the original list
               and if possible find the caddr and use that.  */
            elt = XCONS (elt)->cdr;
            if (NILP (elt))
              break;
            else if (!CONSP (elt))
              goto invalid;
            elt = XCONS (elt)->car;
            goto tail_recurse;
          }
        else if (INTEGERP (car))
          {
            register int lim = XINT (car);
            elt = XCONS (elt)->cdr;
            if (lim < 0)
              {
                /* Negative int means reduce maximum width.  */
                if (precision <= 0)
                  precision = -lim;
                else
                  precision = min (precision, -lim);
              }
            else if (lim > 0)
              {
                /* Padding specified.  Don't let it be more than
                   current maximum.  */
                if (precision > 0)
                  lim = min (precision, lim);

                /* If that's more padding than already wanted, queue it.
                   But don't reduce padding already specified even if
                   that is beyond the current truncation point.  */
                field_width = max (lim, field_width);
              }
            goto tail_recurse;
          }
        else if (STRINGP (car) || CONSP (car))
          {
            register int limit = 50;
            /* Limit is to protect against circular lists.  */
            while (CONSP (elt)
                   && --limit > 0
                   && (precision <= 0 || n < precision))
              {
                n += display_mode_element (it, depth, field_width - n,
                                           precision - n, XCONS (elt)->car);
                elt = XCONS (elt)->cdr;
              }
          }
      }
      break;

    default:
    invalid:
      if (frame_title_ptr)
        n += store_frame_title ("*invalid*", 0, precision - n);
      else
        n += display_string ("*invalid*", Qnil, Qnil, 0, 0, it, 0,
                             precision - n, 0, 0);
      return n;
    }

  /* Pad to FIELD_WIDTH.  */
  if (field_width > 0 && n < field_width)
    {
      if (frame_title_ptr)
        n += store_frame_title ("", field_width - n, 0);
      else
        n += display_string ("", Qnil, Qnil, 0, 0, it, field_width - n,
                             0, 0, 0);
    }
  
  return n;
}


/* Write a null-terminated, right justified decimal representation of
   the positive integer D to BUF using a minimal field width WIDTH.  */

static void
pint2str (buf, width, d)
     register char *buf;
     register int width;
     register int d;
{
  register char *p = buf;
  
  if (d <= 0)
    *p++ = '0';
  else
    {
      while (d > 0)
        {
          *p++ = d % 10 + '0';
          d /= 10;
        }
    }
  
  for (width -= (int) (p - buf); width > 0; --width)
    *p++ = ' ';
  *p-- = '\0';
  while (p > buf)
    {
      d = *buf;
      *buf++ = *p;
      *p-- = d;
    }
}

/* Set a mnemonic character for coding_system (Lisp symbol) in BUF.
   If EOL_FLAG is 1, set also a mnemonic character for end-of-line
   type of CODING_SYSTEM.  Return updated pointer into BUF.  */

static unsigned char invalid_eol_type[] = "(*invalid*)";

static char *
decode_mode_spec_coding (coding_system, buf, eol_flag)
     Lisp_Object coding_system;
     register char *buf;
     int eol_flag;
{
  Lisp_Object val;
  int multibyte = !NILP (current_buffer->enable_multibyte_characters);
  unsigned char *eol_str;
  int eol_str_len;
  /* The EOL conversion we are using.  */
  Lisp_Object eoltype;

  val = coding_system;

  if (NILP (val))               /* Not yet decided.  */
    {
      if (multibyte)
        *buf++ = '-';
      if (eol_flag)
        eoltype = eol_mnemonic_undecided;
      /* Don't mention EOL conversion if it isn't decided.  */
    }
  else
    {
      Lisp_Object eolvalue;

      eolvalue = Fget (coding_system, Qeol_type);

      while (!NILP (val) && SYMBOLP (val))
        {
          val = Fget (val, Qcoding_system);
          if (NILP (eolvalue))
            eolvalue = Fget (val, Qeol_type);
        }

      if (multibyte)
        *buf++ = XFASTINT (XVECTOR (val)->contents[1]);

      if (eol_flag)
        {
          /* The EOL conversion that is normal on this system.  */

          if (NILP (eolvalue))  /* Not yet decided.  */
            eoltype = eol_mnemonic_undecided;
          else if (VECTORP (eolvalue)) /* Not yet decided.  */
            eoltype = eol_mnemonic_undecided;
          else                  /* INTEGERP (eolvalue) -- 0:LF, 1:CRLF, 2:CR */
            eoltype = (XFASTINT (eolvalue) == 0
                       ? eol_mnemonic_unix
                       : (XFASTINT (eolvalue) == 1
                          ? eol_mnemonic_dos : eol_mnemonic_mac));
        }
    }
  
  if (eol_flag)
    {
      /* Mention the EOL conversion if it is not the usual one.  */
      if (STRINGP (eoltype))
        {
          eol_str = XSTRING (eoltype)->data;
          eol_str_len = XSTRING (eoltype)->size;
        }
      else if (INTEGERP (eoltype)
               && CHAR_VALID_P (XINT (eoltype), 0))
        {
          int c = XINT (eoltype);
          unsigned char work[4];

          eol_str_len = CHAR_STRING (XINT (eoltype), work, eol_str);
        }
      else
        {
          eol_str = invalid_eol_type;
          eol_str_len = sizeof (invalid_eol_type) - 1;
        }
      bcopy (eol_str, buf, eol_str_len);
      buf += eol_str_len;
    }

  return buf;
}

/* Return a string for the output of a mode line %-spec for window W,
   generated by character C.  PRECISION >= 0 means don't return a
   string longer than that value.  FIELD_WIDTH > 0 means pad the
   string returned with spaces to that value.  */

static char lots_of_dashes[] = "--------------------------------------------------------------------------------------------------------------------------------------------";

static char *
decode_mode_spec (w, c, field_width, precision)
     struct window *w;
     register char c;
     int field_width, precision;
{
  Lisp_Object obj;
  struct frame *f = XFRAME (WINDOW_FRAME (w));
  char *decode_mode_spec_buf = f->decode_mode_spec_buffer;
  struct buffer *b = XBUFFER (w->buffer);

  obj = Qnil;

  switch (c)
    {
    case '*':
      if (!NILP (b->read_only))
        return "%";
      if (BUF_MODIFF (b) > BUF_SAVE_MODIFF (b))
        return "*";
      return "-";

    case '+':
      /* This differs from %* only for a modified read-only buffer.  */
      if (BUF_MODIFF (b) > BUF_SAVE_MODIFF (b))
        return "*";
      if (!NILP (b->read_only))
        return "%";
      return "-";

    case '&':
      /* This differs from %* in ignoring read-only-ness.  */
      if (BUF_MODIFF (b) > BUF_SAVE_MODIFF (b))
        return "*";
      return "-";

    case '%':
      return "%";

    case '[': 
      {
        int i;
        char *p;

        if (command_loop_level > 5)
          return "[[[... ";
        p = decode_mode_spec_buf;
        for (i = 0; i < command_loop_level; i++)
          *p++ = '[';
        *p = 0;
        return decode_mode_spec_buf;
      }

    case ']': 
      {
        int i;
        char *p;

        if (command_loop_level > 5)
          return " ...]]]";
        p = decode_mode_spec_buf;
        for (i = 0; i < command_loop_level; i++)
          *p++ = ']';
        *p = 0;
        return decode_mode_spec_buf;
      }

    case '-':
      {
        register int i;

        /* Let lots_of_dashes be a string of infinite length.  */
        if (field_width <= 0
            || field_width > sizeof (lots_of_dashes))
          {
            for (i = 0; i < FRAME_MESSAGE_BUF_SIZE (f) - 1; ++i)
              decode_mode_spec_buf[i] = '-';
            decode_mode_spec_buf[i] = '\0';
            return decode_mode_spec_buf;
          }
        else
          return lots_of_dashes;
      }

    case 'b': 
      obj = b->name;
      break;

    case 'c':
      {
        int col = current_column ();
        XSETFASTINT (w->column_number_displayed, col);
        pint2str (decode_mode_spec_buf, field_width, col);
        return decode_mode_spec_buf;
      }

    case 'F':
      /* %F displays the frame name.  */
      if (!NILP (f->title))
        return (char *) XSTRING (f->title)->data;
      if (f->explicit_name || ! FRAME_WINDOW_P (f))
        return (char *) XSTRING (f->name)->data;
      return "Emacs";

    case 'f': 
      obj = b->filename;
      break;

    case 'l':
      {
        int startpos = XMARKER (w->start)->charpos;
        int startpos_byte = marker_byte_position (w->start);
        int line, linepos, linepos_byte, topline;
        int nlines, junk;
        int height = XFASTINT (w->height);

        /* If we decided that this buffer isn't suitable for line numbers, 
           don't forget that too fast.  */
        if (EQ (w->base_line_pos, w->buffer))
          goto no_value;
        /* But do forget it, if the window shows a different buffer now.  */
        else if (BUFFERP (w->base_line_pos))
          w->base_line_pos = Qnil;

        /* If the buffer is very big, don't waste time.  */
        if (BUF_ZV (b) - BUF_BEGV (b) > line_number_display_limit)
          {
            w->base_line_pos = Qnil;
            w->base_line_number = Qnil;
            goto no_value;
          }

        if (!NILP (w->base_line_number)
            && !NILP (w->base_line_pos)
            && XFASTINT (w->base_line_pos) <= startpos)
          {
            line = XFASTINT (w->base_line_number);
            linepos = XFASTINT (w->base_line_pos);
            linepos_byte = buf_charpos_to_bytepos (b, linepos);
          }
        else
          {
            line = 1;
            linepos = BUF_BEGV (b);
            linepos_byte = BUF_BEGV_BYTE (b);
          }

        /* Count lines from base line to window start position.  */
        nlines = display_count_lines (linepos, linepos_byte,
                                      startpos_byte,
                                      startpos, &junk);

        topline = nlines + line;

        /* Determine a new base line, if the old one is too close
           or too far away, or if we did not have one.
           "Too close" means it's plausible a scroll-down would
           go back past it.  */
        if (startpos == BUF_BEGV (b))
          {
            XSETFASTINT (w->base_line_number, topline);
            XSETFASTINT (w->base_line_pos, BUF_BEGV (b));
          }
        else if (nlines < height + 25 || nlines > height * 3 + 50
                 || linepos == BUF_BEGV (b))
          {
            int limit = BUF_BEGV (b);
            int limit_byte = BUF_BEGV_BYTE (b);
            int position;
            int distance = (height * 2 + 30) * 200;

            if (startpos - distance > limit)
              {
                limit = startpos - distance;
                limit_byte = CHAR_TO_BYTE (limit);
              }

            nlines = display_count_lines (startpos, startpos_byte,
                                          limit_byte,
                                          - (height * 2 + 30),
                                          &position);
            /* If we couldn't find the lines we wanted within 
               200 chars per line,
               give up on line numbers for this window.  */
            if (position == limit_byte && limit == startpos - distance)
              {
                w->base_line_pos = w->buffer;
                w->base_line_number = Qnil;
                goto no_value;
              }

            XSETFASTINT (w->base_line_number, topline - nlines);
            XSETFASTINT (w->base_line_pos, BYTE_TO_CHAR (position));
          }

        /* Now count lines from the start pos to point.  */
        nlines = display_count_lines (startpos, startpos_byte,
                                      PT_BYTE, PT, &junk);

        /* Record that we did display the line number.  */
        line_number_displayed = 1;

        /* Make the string to show.  */
        pint2str (decode_mode_spec_buf, field_width, topline + nlines);
        return decode_mode_spec_buf;
    no_value:
        {
          char* p = decode_mode_spec_buf;
          int pad = field_width - 2;
          while (pad-- > 0)
            *p++ = ' ';
          *p++ = '?';
          *p = '?';
          return decode_mode_spec_buf;
        }
      }
      break;

    case 'm': 
      obj = b->mode_name;
      break;

    case 'n':
      if (BUF_BEGV (b) > BUF_BEG (b) || BUF_ZV (b) < BUF_Z (b))
        return " Narrow";
      break;

    case 'p':
      {
        int pos = marker_position (w->start);
        int total = BUF_ZV (b) - BUF_BEGV (b);

        if (XFASTINT (w->window_end_pos) <= BUF_Z (b) - BUF_ZV (b))
          {
            if (pos <= BUF_BEGV (b))
              return "All";
            else
              return "Bottom";
          }
        else if (pos <= BUF_BEGV (b))
          return "Top";
        else
          {
            if (total > 1000000)
              /* Do it differently for a large value, to avoid overflow.  */
              total = ((pos - BUF_BEGV (b)) + (total / 100) - 1) / (total / 100);
            else
              total = ((pos - BUF_BEGV (b)) * 100 + total - 1) / total;
            /* We can't normally display a 3-digit number,
               so get us a 2-digit number that is close.  */
            if (total == 100)
              total = 99;
            sprintf (decode_mode_spec_buf, "%2d%%", total);
            return decode_mode_spec_buf;
          }
      }

      /* Display percentage of size above the bottom of the screen.  */
    case 'P':
      {
        int toppos = marker_position (w->start);
        int botpos = BUF_Z (b) - XFASTINT (w->window_end_pos);
        int total = BUF_ZV (b) - BUF_BEGV (b);

        if (botpos >= BUF_ZV (b))
          {
            if (toppos <= BUF_BEGV (b))
              return "All";
            else
              return "Bottom";
          }
        else
          {
            if (total > 1000000)
              /* Do it differently for a large value, to avoid overflow.  */
              total = ((botpos - BUF_BEGV (b)) + (total / 100) - 1) / (total / 100);
            else
              total = ((botpos - BUF_BEGV (b)) * 100 + total - 1) / total;
            /* We can't normally display a 3-digit number,
               so get us a 2-digit number that is close.  */
            if (total == 100)
              total = 99;
            if (toppos <= BUF_BEGV (b))
              sprintf (decode_mode_spec_buf, "Top%2d%%", total);
            else
              sprintf (decode_mode_spec_buf, "%2d%%", total);
            return decode_mode_spec_buf;
          }
      }

    case 's':
      /* status of process */
      obj = Fget_buffer_process (w->buffer);
      if (NILP (obj))
        return "no process";
#ifdef subprocesses
      obj = Fsymbol_name (Fprocess_status (obj));
#endif
      break;

    case 't':                   /* indicate TEXT or BINARY */
#ifdef MODE_LINE_BINARY_TEXT
      return MODE_LINE_BINARY_TEXT (b);
#else
      return "T";
#endif

    case 'z':
      /* coding-system (not including end-of-line format) */
    case 'Z':
      /* coding-system (including end-of-line type) */
      {
        int eol_flag = (c == 'Z');
        char *p = decode_mode_spec_buf;

        if (! FRAME_WINDOW_P (f))
          {
            /* No need to mention EOL here--the terminal never needs
               to do EOL conversion.  */
            p = decode_mode_spec_coding (keyboard_coding.symbol, p, 0);
            p = decode_mode_spec_coding (terminal_coding.symbol, p, 0);
          }
        p = decode_mode_spec_coding (b->buffer_file_coding_system,
                                     p, eol_flag);

#if 0 /* This proves to be annoying; I think we can do without.  -- rms.  */
#ifdef subprocesses
        obj = Fget_buffer_process (Fcurrent_buffer ());
        if (PROCESSP (obj))
          {
            p = decode_mode_spec_coding (XPROCESS (obj)->decode_coding_system,
                                         p, eol_flag);
            p = decode_mode_spec_coding (XPROCESS (obj)->encode_coding_system,
                                         p, eol_flag);
          }
#endif /* subprocesses */
#endif /* 0 */
        *p = 0;
        return decode_mode_spec_buf;
      }
    }

  if (STRINGP (obj))
    return (char *) XSTRING (obj)->data;
  else
    return "";
}


/* Count up to COUNT lines starting from START / START_BYTE.
   But don't go beyond LIMIT_BYTE.
   Return the number of lines thus found (always nonnegative).

   Set *BYTE_POS_PTR to 1 if we found COUNT lines, 0 if we hit LIMIT.  */

static int
display_count_lines (start, start_byte, limit_byte, count, byte_pos_ptr)
     int start, start_byte, limit_byte, count;
     int *byte_pos_ptr;
{
  register unsigned char *cursor;
  unsigned char *base;

  register int ceiling;
  register unsigned char *ceiling_addr;
  int orig_count = count;

  /* If we are not in selective display mode,
     check only for newlines.  */
  int selective_display = (!NILP (current_buffer->selective_display)
                           && !INTEGERP (current_buffer->selective_display));

  if (count > 0)
    {
      while (start_byte < limit_byte)
        {
          ceiling =  BUFFER_CEILING_OF (start_byte);
          ceiling = min (limit_byte - 1, ceiling);
          ceiling_addr = BYTE_POS_ADDR (ceiling) + 1;
          base = (cursor = BYTE_POS_ADDR (start_byte));
          while (1)
            {
              if (selective_display)
                while (*cursor != '\n' && *cursor != 015 && ++cursor != ceiling_addr)
                  ;
              else
                while (*cursor != '\n' && ++cursor != ceiling_addr)
                  ;

              if (cursor != ceiling_addr)
                {
                  if (--count == 0)
                    {
                      start_byte += cursor - base + 1;
                      *byte_pos_ptr = start_byte;
                      return orig_count;
                    }
                  else
                    if (++cursor == ceiling_addr)
                      break;
                }
              else
                break;
            }
          start_byte += cursor - base;
        }
    }
  else
    {
      while (start_byte > limit_byte)
        {
          ceiling = BUFFER_FLOOR_OF (start_byte - 1);
          ceiling = max (limit_byte, ceiling);
          ceiling_addr = BYTE_POS_ADDR (ceiling) - 1;
          base = (cursor = BYTE_POS_ADDR (start_byte - 1) + 1);
          while (1)
            {
              if (selective_display)
                while (--cursor != ceiling_addr
                       && *cursor != '\n' && *cursor != 015)
                  ;
              else
                while (--cursor != ceiling_addr && *cursor != '\n')
                  ;

              if (cursor != ceiling_addr)
                {
                  if (++count == 0)
                    {
                      start_byte += cursor - base + 1;
                      *byte_pos_ptr = start_byte;
                      /* When scanning backwards, we should
                         not count the newline posterior to which we stop.  */
                      return - orig_count - 1;
                    }
                }
              else
                break;
            }
          /* Here we add 1 to compensate for the last decrement
             of CURSOR, which took it past the valid range.  */
          start_byte += cursor - base + 1;
        }
    }

  *byte_pos_ptr = limit_byte;

  if (count < 0)
    return - orig_count + count;
  return orig_count - count;

}


\f
/***********************************************************************
                         Displaying strings
 ***********************************************************************/

/* Display a NUL-terminated string, starting with index START.

   If STRING is non-null, display that C string.  Otherwise, the Lisp
   string LISP_STRING is displayed.

   If FACE_STRING is not nil, FACE_STRING_POS is a position in
   FACE_STRING.  Display STRING or LISP_STRING with the face at
   FACE_STRING_POS in FACE_STRING:

   Display the string in the environment given by IT, but use the
   standard display table, temporarily.

   FIELD_WIDTH is the minimum number of output glyphs to produce.
   If STRING has fewer characters than FIELD_WIDTH, pad to the right
   with spaces.  If STRING has more characters, more than FIELD_WIDTH
   glyphs will be produced.  FIELD_WIDTH <= 0 means don't pad.
   
   PRECISION is the maximum number of characters to output from
   STRING.  PRECISION < 0  means don't truncate the string.

   This is roughly equivalent to printf format specifiers:

   FIELD_WIDTH  PRECISION       PRINTF
   ----------------------------------------
   -1           -1              %s
   -1           10              %.10s
   10           -1              %10s
   20           10              %20.10s

   MULTIBYTE zero means do not display multibyte chars, > 0 means do
   display them, and < 0 means obey the current buffer's value of
   enable_multibyte_characters.

   Value is the number of glyphs produced.  */

static int
display_string (string, lisp_string, face_string, face_string_pos,
                start, it, field_width, precision, max_x, multibyte)
     unsigned char *string;
     Lisp_Object lisp_string;
     int start;
     struct it *it;
     int field_width, precision, max_x;
     int multibyte;
{
  int hpos_at_start = it->hpos;
  int saved_face_id = it->face_id;
  struct glyph_row *row = it->glyph_row;

  /* Initialize the iterator IT for iteration over STRING beginning
     with index START.  We assume that IT may be modified here (which
     means that display_line has to do something when displaying a
     mini-buffer prompt, which it does).  */
  reseat_to_string (it, string, lisp_string, start,
                    precision, field_width, multibyte);

  /* If displaying STRING, set up the face of the iterator
     from LISP_STRING, if that's given.  */
  if (STRINGP (face_string))
    {
      int endptr;
      struct face *face;
      
      it->face_id
        = face_at_string_position (it->w, face_string, face_string_pos,
                                   0, it->region_beg_charpos,
                                   it->region_end_charpos,
                                   &endptr, it->base_face_id);
      face = FACE_FROM_ID (it->f, it->face_id);
      it->face_box_p = face->box != FACE_NO_BOX;
    }

  /* Set max_x to the maximum allowed X position.  Don't let it go
     beyond the right edge of the window.  */
  if (max_x <= 0)
    max_x = it->last_visible_x;
  else
    max_x = min (max_x, it->last_visible_x);

  /* Skip over display elements that are not visible. because IT->w is
     hscrolled.  */
  if (it->current_x < it->first_visible_x)
    move_it_in_display_line_to (it, 100000, it->first_visible_x,
                                MOVE_TO_POS | MOVE_TO_X);

  row->ascent = it->max_ascent;
  row->height = it->max_ascent + it->max_descent;

  /* This condition is for the case that we are called with current_x
     past last_visible_x.  */
  while (it->current_x < max_x)
    {
      int x_before, x, n_glyphs_before, i, nglyphs;

      /* Get the next display element.  */
      if (!get_next_display_element (it))
        break;

      /* Produce glyphs.  */
      x_before = it->current_x;
      n_glyphs_before = it->glyph_row->used[TEXT_AREA];
      PRODUCE_GLYPHS (it);

      nglyphs = it->glyph_row->used[TEXT_AREA] - n_glyphs_before;
      i = 0;
      x = x_before;
      while (i < nglyphs)
        {
          struct glyph *glyph = row->glyphs[TEXT_AREA] + n_glyphs_before + i;
          
          if (!it->truncate_lines_p
              && x + glyph->pixel_width > max_x)
            {
              /* End of continued line or max_x reached.  */
              it->glyph_row->used[TEXT_AREA] = n_glyphs_before + i;
              it->current_x = x;
              break;
            }
          else if (x + glyph->pixel_width > it->first_visible_x)
            {
              /* Glyph is at least partially visible.  */
              ++it->hpos;
              if (x < it->first_visible_x)
                it->glyph_row->x = x - it->first_visible_x;
            }
          else
            {
              /* Glyph is off the left margin of the display area.
                 Should not happen.  */
              abort ();
            }

          row->ascent = max (row->ascent, it->max_ascent);
          row->height = max (row->height, it->max_ascent + it->max_descent);
          x += glyph->pixel_width;
          ++i;
        }

      /* Stop if max_x reached.  */
      if (i < nglyphs)
        break;

      /* Stop at line ends.  */
      if (ITERATOR_AT_END_OF_LINE_P (it))
        {
          it->continuation_lines_width = 0;
          break;
        }

      set_iterator_to_next (it);

      /* Stop if truncating at the right edge.  */
      if (it->truncate_lines_p
          && it->current_x >= it->last_visible_x)
        {
          /* Add truncation mark, but don't do it if the line is
             truncated at a padding space.  */
          if (IT_CHARPOS (*it) < it->string_nchars)
            {
              if (!FRAME_WINDOW_P (it->f))
                produce_special_glyphs (it, IT_TRUNCATION);
              it->glyph_row->truncated_on_right_p = 1;
            }
          break;
        }
    }

  /* Maybe insert a truncation at the left.  */
  if (it->first_visible_x
      && IT_CHARPOS (*it) > 0)
    {
      if (!FRAME_WINDOW_P (it->f))
        insert_left_trunc_glyphs (it);
      it->glyph_row->truncated_on_left_p = 1;
    }

  it->face_id = saved_face_id;
  
  /* Value is number of columns displayed.  */
  return it->hpos - hpos_at_start;
}


\f
/* This is like a combination of memq and assq.  Return 1 if PROPVAL
   appears as an element of LIST or as the car of an element of LIST.
   If PROPVAL is a list, compare each element against LIST in that
   way, and return 1 if any element of PROPVAL is found in LIST.
   Otherwise return 0.  This function cannot quit.  */

int
invisible_p (propval, list)
     register Lisp_Object propval;
     Lisp_Object list;
{
  register Lisp_Object tail, proptail;
  for (tail = list; CONSP (tail); tail = XCONS (tail)->cdr)
    {
      register Lisp_Object tem;
      tem = XCONS (tail)->car;
      if (EQ (propval, tem))
        return 1;
      if (CONSP (tem) && EQ (propval, XCONS (tem)->car))
        return 1;
    }
  if (CONSP (propval))
    for (proptail = propval; CONSP (proptail);
         proptail = XCONS (proptail)->cdr)
      {
        Lisp_Object propelt;
        propelt = XCONS (proptail)->car;
        for (tail = list; CONSP (tail); tail = XCONS (tail)->cdr)
          {
            register Lisp_Object tem;
            tem = XCONS (tail)->car;
            if (EQ (propelt, tem))
              return 1;
            if (CONSP (tem) && EQ (propelt, XCONS (tem)->car))
              return 1;
          }
      }
  return 0;
}


/* Return 1 if PROPVAL appears as the car of an element of LIST and
   the cdr of that element is non-nil.  If PROPVAL is a list, check
   each element of PROPVAL in that way, and the first time some
   element is found, return 1 if the cdr of that element is non-nil.
   Otherwise return 0.  This function cannot quit.  */

int
invisible_ellipsis_p (propval, list)
     register Lisp_Object propval;
     Lisp_Object list;
{
  register Lisp_Object tail, proptail;
  for (tail = list; CONSP (tail); tail = XCONS (tail)->cdr)
    {
      register Lisp_Object tem;
      tem = XCONS (tail)->car;
      if (CONSP (tem) && EQ (propval, XCONS (tem)->car))
        return ! NILP (XCONS (tem)->cdr);
    }
  if (CONSP (propval))
    for (proptail = propval; CONSP (proptail);
         proptail = XCONS (proptail)->cdr)
      {
        Lisp_Object propelt;
        propelt = XCONS (proptail)->car;
        for (tail = list; CONSP (tail); tail = XCONS (tail)->cdr)
          {
            register Lisp_Object tem;
            tem = XCONS (tail)->car;
            if (CONSP (tem) && EQ (propelt, XCONS (tem)->car))
              return ! NILP (XCONS (tem)->cdr);
          }
      }
  return 0;
}


\f
/***********************************************************************
                            Initialization
 ***********************************************************************/

void
syms_of_xdisp ()
{
  echo_area_message = previous_echo_area_message = Qnil;
  staticpro (&echo_area_message);
  staticpro (&previous_echo_area_message);

  staticpro (&Qinhibit_redisplay);
  Qinhibit_redisplay = intern ("inhibit-redisplay");

#if GLYPH_DEBUG
  defsubr (&Sdump_glyph_matrix);
  defsubr (&Sdump_glyph_row);
  defsubr (&Sdump_toolbar_row);
  defsubr (&Strace_redisplay_toggle);
#endif

  staticpro (&Qmenu_bar_update_hook);
  Qmenu_bar_update_hook = intern ("menu-bar-update-hook");

  staticpro (&Qoverriding_terminal_local_map);
  Qoverriding_terminal_local_map = intern ("overriding-terminal-local-map");

  staticpro (&Qoverriding_local_map);
  Qoverriding_local_map = intern ("overriding-local-map");

  staticpro (&Qwindow_scroll_functions);
  Qwindow_scroll_functions = intern ("window-scroll-functions");

  staticpro (&Qredisplay_end_trigger_functions);
  Qredisplay_end_trigger_functions = intern ("redisplay-end-trigger-functions");
  
  staticpro (&Qinhibit_point_motion_hooks);
  Qinhibit_point_motion_hooks = intern ("inhibit-point-motion-hooks");

  staticpro (&Qdisplay);
  Qdisplay = intern ("display");
  staticpro (&Qleft_margin);
  Qspace_width = intern ("space-width");
  staticpro (&Qspace_width);
  Qheight = intern ("height");
  staticpro (&Qheight);
  Qraise = intern ("raise");
  staticpro (&Qraise);
  Qspace = intern ("space");
  staticpro (&Qspace);
  Qleft_margin = intern ("left-margin");
  staticpro (&Qright_margin);
  Qright_margin = intern ("right-margin");
  Qalign_to = intern ("align-to");
  staticpro (&Qalign_to);
  QCalign_to = intern (":align-to");
  staticpro (&QCalign_to);
  Qwidth = intern ("width");
  staticpro (&Qwidth);
  Qrelative_width = intern ("relative-width");
  staticpro (&Qrelative_width);
  QCrelative_width = intern (":relative-width");
  staticpro (&QCrelative_width);
  QCrelative_height = intern (":relative-height");
  staticpro (&QCrelative_height);
  QCeval = intern (":eval");
  staticpro (&QCeval);
  QCwhen = intern (":when");
  staticpro (&QCwhen);
  Qfontified = intern ("fontified");
  staticpro (&Qfontified);
  Qfontification_functions = intern ("fontification-functions");
  staticpro (&Qfontification_functions);
  Qshow_trailing_whitespace = intern ("show-trailing-whitespace");
  staticpro (&Qshow_trailing_whitespace);
  Qtrailing_whitespace = intern ("trailing-whitespace");
  staticpro (&Qtrailing_whitespace);
  Qimage = intern ("image");
  staticpro (&Qimage);

  staticpro (&last_arrow_position);
  staticpro (&last_arrow_string);
  last_arrow_position = Qnil;
  last_arrow_string = Qnil;

  DEFVAR_LISP ("inhibit-redisplay", &Vinhibit_redisplay,
    "Non-nil means don't actually do any redisplay.\n\
This is used for internal purposes.");
  Vinhibit_redisplay = Qnil;

  DEFVAR_LISP ("global-mode-string", &Vglobal_mode_string,
    "String (or mode line construct) included (normally) in `mode-line-format'.");
  Vglobal_mode_string = Qnil;

  DEFVAR_LISP ("overlay-arrow-position", &Voverlay_arrow_position,
    "Marker for where to display an arrow on top of the buffer text.\n\
This must be the beginning of a line in order to work.\n\
See also `overlay-arrow-string'.");
  Voverlay_arrow_position = Qnil;

  DEFVAR_LISP ("overlay-arrow-string", &Voverlay_arrow_string,
    "String to display as an arrow.  See also `overlay-arrow-position'.");
  Voverlay_arrow_string = Qnil;

  DEFVAR_INT ("scroll-step", &scroll_step,
    "*The number of lines to try scrolling a window by when point moves out.\n\
If that fails to bring point back on frame, point is centered instead.\n\
If this is zero, point is always centered after it moves off frame.");

  DEFVAR_INT ("scroll-conservatively", &scroll_conservatively,
    "*Scroll up to this many lines, to bring point back on screen.");
  scroll_conservatively = 0;

  DEFVAR_INT ("scroll-margin", &scroll_margin,
    "*Number of lines of margin at the top and bottom of a window.\n\
Recenter the window whenever point gets within this many lines\n\
of the top or bottom of the window.");
  scroll_margin = 0;

#if GLYPH_DEBUG
  DEFVAR_INT ("debug-end-pos", &debug_end_pos, "Don't ask");
#endif

  DEFVAR_BOOL ("truncate-partial-width-windows",
               &truncate_partial_width_windows,
    "*Non-nil means truncate lines in all windows less than full frame wide.");
  truncate_partial_width_windows = 1;

  DEFVAR_BOOL ("mode-line-inverse-video", &mode_line_inverse_video,
    "*Non-nil means use inverse video for the mode line.");
  mode_line_inverse_video = 1;

  DEFVAR_INT ("line-number-display-limit", &line_number_display_limit,
    "*Maximum buffer size for which line number should be displayed.\n\
If the buffer is bigger than this, the line number does not appear\n\
in the mode line.");
  line_number_display_limit = 1000000;

  DEFVAR_BOOL ("highlight-nonselected-windows", &highlight_nonselected_windows,
    "*Non-nil means highlight region even in nonselected windows.");
  highlight_nonselected_windows = 0;

  DEFVAR_BOOL ("multiple-frames", &multiple_frames,
    "Non-nil if more than one frame is visible on this display.\n\
Minibuffer-only frames don't count, but iconified frames do.\n\
This variable is not guaranteed to be accurate except while processing\n\
`frame-title-format' and `icon-title-format'.");

  DEFVAR_LISP ("frame-title-format", &Vframe_title_format,
    "Template for displaying the title bar of visible frames.\n\
\(Assuming the window manager supports this feature.)\n\
This variable has the same structure as `mode-line-format' (which see),\n\
and is used only on frames for which no explicit name has been set\n\
\(see `modify-frame-parameters').");
  DEFVAR_LISP ("icon-title-format", &Vicon_title_format,
    "Template for displaying the title bar of an iconified frame.\n\
\(Assuming the window manager supports this feature.)\n\
This variable has the same structure as `mode-line-format' (which see),\n\
and is used only on frames for which no explicit name has been set\n\
\(see `modify-frame-parameters').");
  Vicon_title_format
    = Vframe_title_format
    = Fcons (intern ("multiple-frames"),
             Fcons (build_string ("%b"),
                    Fcons (Fcons (build_string (""),
                                  Fcons (intern ("invocation-name"),
                                         Fcons (build_string ("@"),
                                                Fcons (intern ("system-name"),
                                                               Qnil)))),
                           Qnil)));

  DEFVAR_LISP ("message-log-max", &Vmessage_log_max,
    "Maximum number of lines to keep in the message log buffer.\n\
If nil, disable message logging.  If t, log messages but don't truncate\n\
the buffer when it becomes large.");
  XSETFASTINT (Vmessage_log_max, 50);

  DEFVAR_LISP ("window-size-change-functions", &Vwindow_size_change_functions,
    "Functions called before redisplay, if window sizes have changed.\n\
The value should be a list of functions that take one argument.\n\
Just before redisplay, for each frame, if any of its windows have changed\n\
size since the last redisplay, or have been split or deleted,\n\
all the functions in the list are called, with the frame as argument.");
  Vwindow_size_change_functions = Qnil;

  DEFVAR_LISP ("window-scroll-functions", &Vwindow_scroll_functions,
    "List of Functions to call before redisplaying a window with scrolling.\n\
Each function is called with two arguments, the window\n\
and its new display-start position.  Note that the value of `window-end'\n\
is not valid when these functions are called.");
  Vwindow_scroll_functions = Qnil;
  
  DEFVAR_BOOL ("auto-resize-toolbars", &auto_resize_toolbars_p,
    "*Non-nil means automatically resize toolbars.\n\
This increases a toolbar's height if not all toolbar items are visible.\n\
It decreases a toolbar's height when it would display blank lines\n\
otherwise.");
  auto_resize_toolbars_p = 1;
  
  DEFVAR_BOOL ("auto-raise-toolbar-buttons", &auto_raise_toolbar_buttons_p,
    "*Non-nil means raise toolbar buttons when the mouse moves over them.");
  auto_raise_toolbar_buttons_p = 1;

  DEFVAR_INT ("toolbar-button-margin", &toolbar_button_margin,
    "*Margin around toolbar buttons in pixels.");
  toolbar_button_margin = 1;

  DEFVAR_INT ("toolbar-button-relief", &toolbar_button_relief,
    "Relief thickness of toolbar buttons.");
  toolbar_button_relief = 3;

  DEFVAR_LISP ("fontification-functions", &Vfontification_functions,
    "List of functions to call to fontify regions of text.\n\
Each function is called with one argument POS.  Functions must\n\
fontify a region starting at POS in the current buffer, and give\n\
fontified regions the property `fontified'.\n\
This variable automatically becomes buffer-local when set.");
  Vfontification_functions = Qnil;
  Fmake_local_variable (Qfontification_functions);

  DEFVAR_BOOL ("unibyte-display-via-language-environment",
               &unibyte_display_via_language_environment,
    "*Non-nil means display unibyte text according to language environment.\n\
Specifically this means that unibyte non-ASCII characters\n\
are displayed by converting them to the equivalent multibyte characters\n\
according to the current language environment.  As a result, they are\n\
displayed according to the current fontset.");
  unibyte_display_via_language_environment = 0;
}


/* Initialize this module when Emacs starts.  */

void
init_xdisp ()
{
  Lisp_Object root_window;
  struct window *mini_w;

  CHARPOS (this_line_start_pos) = 0;

  mini_w = XWINDOW (minibuf_window);
  root_window = FRAME_ROOT_WINDOW (XFRAME (WINDOW_FRAME (mini_w)));

  echo_area_glyphs = 0;
  previous_echo_glyphs = 0;
  echo_area_message = previous_echo_area_message = Qnil;

  if (!noninteractive)
    {
      struct frame *f = XFRAME (WINDOW_FRAME (XWINDOW (root_window)));
      int i;

      XSETFASTINT (XWINDOW (root_window)->top, FRAME_TOP_MARGIN (f));
      set_window_height (root_window,
                         FRAME_HEIGHT (f) - 1 - FRAME_TOP_MARGIN (f),
                         0);
      XSETFASTINT (mini_w->top, FRAME_HEIGHT (f) - 1);
      set_window_height (minibuf_window, 1, 0);

      XSETFASTINT (XWINDOW (root_window)->width, FRAME_WIDTH (f));
      XSETFASTINT (mini_w->width, FRAME_WIDTH (f));

      scratch_glyph_row.glyphs[TEXT_AREA] = scratch_glyphs;
      scratch_glyph_row.glyphs[TEXT_AREA + 1]
        = scratch_glyphs + MAX_SCRATCH_GLYPHS;

      /* The default ellipsis glyphs `...'.  */ 
      for (i = 0; i < 3; ++i)
        XSETFASTINT (default_invis_vector[i], '.');
    }

#ifdef HAVE_WINDOW_SYSTEM
  {
    /* Allocate the buffer for frame titles.  */
    int size = 100;
    frame_title_buf = (char *) xmalloc (size);
    frame_title_buf_end = frame_title_buf + size;
    frame_title_ptr = NULL;
  }
#endif /* HAVE_WINDOW_SYSTEM */
}