Utf8ToUtf16CharacterStream Class Reference

#include <scanner-character-streams.h>

Inheritance diagram for Utf8ToUtf16CharacterStream:

Collaboration diagram for Utf8ToUtf16CharacterStream:

Public Member Functions
	Utf8ToUtf16CharacterStream (const byte *data, unsigned length)
virtual	~Utf8ToUtf16CharacterStream ()
Public Member Functions inherited from BufferedUtf16CharacterStream
	BufferedUtf16CharacterStream ()
virtual	~BufferedUtf16CharacterStream ()
virtual void	PushBack (uc32 character)
Public Member Functions inherited from Utf16CharacterStream
	Utf16CharacterStream ()
virtual	~Utf16CharacterStream ()
uc32	Advance ()
unsigned	pos () const
unsigned	SeekForward (unsigned code_unit_count)

Protected Member Functions
virtual unsigned	BufferSeekForward (unsigned delta)
virtual unsigned	FillBuffer (unsigned char_position, unsigned length)
void	SetRawPosition (unsigned char_position)
Protected Member Functions inherited from BufferedUtf16CharacterStream
virtual unsigned	SlowSeekForward (unsigned delta)
virtual bool	ReadBlock ()
virtual void	SlowPushBack (uc16 character)

Protected Attributes
const byte *	raw_data_
unsigned	raw_data_length_
unsigned	raw_data_pos_
unsigned	raw_character_position_
Protected Attributes inherited from BufferedUtf16CharacterStream
const uc16 *	pushback_limit_
uc16	buffer_ [kBufferSize]
Protected Attributes inherited from Utf16CharacterStream
const uc16 *	buffer_cursor_
const uc16 *	buffer_end_
unsigned	pos_

Additional Inherited Members
Static Protected Attributes inherited from BufferedUtf16CharacterStream
static const unsigned	kBufferSize = 512
static const unsigned	kPushBackStepSize = 16
Static Protected Attributes inherited from Utf16CharacterStream
static const uc32	kEndOfInput = -1

Detailed Description

Definition at line 81 of file scanner-character-streams.h.

Constructor & Destructor Documentation

Utf8ToUtf16CharacterStream	(	const byte *	data,
		unsigned	length
	)

Definition at line 157 of file scanner-character-streams.cc.

References BufferedUtf16CharacterStream::ReadBlock().

~Utf8ToUtf16CharacterStream ( )

virtual

Definition at line 168 of file scanner-character-streams.cc.

Member Function Documentation

unsigned BufferSeekForward ( unsigned  delta )

protectedvirtual

Implements BufferedUtf16CharacterStream.

Definition at line 171 of file scanner-character-streams.cc.

References Utf16CharacterStream::pos_, Utf8ToUtf16CharacterStream::raw_character_position_, BufferedUtf16CharacterStream::ReadBlock(), and Utf8ToUtf16CharacterStream::SetRawPosition().

unsigned FillBuffer ( unsigned  char_position, unsigned  length  )

protectedvirtual

Implements BufferedUtf16CharacterStream.

Definition at line 181 of file scanner-character-streams.cc.

References BufferedUtf16CharacterStream::buffer_, Utf8::CalculateValue(), Utf8::kMaxOneByteChar, Utf16::LeadSurrogate(), Utf8ToUtf16CharacterStream::raw_character_position_, Utf8ToUtf16CharacterStream::raw_data_, Utf8ToUtf16CharacterStream::raw_data_length_, Utf8ToUtf16CharacterStream::raw_data_pos_, Utf8ToUtf16CharacterStream::SetRawPosition(), and Utf16::TrailSurrogate().

void SetRawPosition ( unsigned  char_position )

protected

Definition at line 274 of file scanner-character-streams.cc.

References ASSERT, Utf8ToUtf16CharacterStream::raw_character_position_, Utf8ToUtf16CharacterStream::raw_data_, Utf8ToUtf16CharacterStream::raw_data_length_, and Utf8ToUtf16CharacterStream::raw_data_pos_.

Referenced by Utf8ToUtf16CharacterStream::BufferSeekForward(), and Utf8ToUtf16CharacterStream::FillBuffer().

Field Documentation

unsigned raw_character_position_

protected

Definition at line 96 of file scanner-character-streams.h.

Referenced by Utf8ToUtf16CharacterStream::BufferSeekForward(), Utf8ToUtf16CharacterStream::FillBuffer(), and Utf8ToUtf16CharacterStream::SetRawPosition().

const byte* raw_data_

protected

Definition at line 91 of file scanner-character-streams.h.

Referenced by Utf8ToUtf16CharacterStream::FillBuffer(), and Utf8ToUtf16CharacterStream::SetRawPosition().

unsigned raw_data_length_

protected

Definition at line 92 of file scanner-character-streams.h.

Referenced by Utf8ToUtf16CharacterStream::FillBuffer(), and Utf8ToUtf16CharacterStream::SetRawPosition().

unsigned raw_data_pos_

protected

Definition at line 93 of file scanner-character-streams.h.

Referenced by Utf8ToUtf16CharacterStream::FillBuffer(), and Utf8ToUtf16CharacterStream::SetRawPosition().

---

The documentation for this class was generated from the following files:

• src/scanner-character-streams.h
• src/scanner-character-streams.cc