For more info on SynEdit go to: SynEdit
Understanding the SynEdit Highlighter
SynEdit - Highlighter relationship
SynEdit <-> Highlighter have an n to 1 relationship.
- 1 (instance of a) Highlighter can serve n (many) (instances of) SynEdits
- Each SynEdit only has one Highlighter
- But: one text (text-buffer) can have many highlighters, if shared by several SynEdit (each SynEdit will have one HL, but all HL will work on the same document)
As a result of this:
- no Highlighter Instance has a (fixed) reference to the SynEdit.
- (Highlighters however keep a list of SynEditTextBuffers to which they are attached)
- All data for the Highlighter is (and must be) stored on the SynEdit (actually on the TextBuffer of SynEdit (referred to as "Lines").
However SynEdit ensures before each call to the Highlighter that Highlighter.CurrentLines is set to the current SynEdits Lines. This way the highlighter can access the data whenever needed. The Format of the data-storage is determined by the highlighter (TSynCustomHighlighter.AttachToLines)
Scanning and Returning Highlight attributes
The Highlighter is expected to work on a per Line base.
If any text was modified, SynEdit will call (TSynCustomHighlighter.ScanFrom / Currently called from TSynEdit.ScanFrom) with the line range. The Highlighter should know the state of the previous line.
If Highlight attributes are required SynEdit will request them per Line too. SynEdit will loop through individual tokens on a line. This currently happens from nested proc PaintLines in SynEdit.PaintTextLines. It calls TSynCustomHighlighter.StartAtLineIndex, followed by HL.GetTokenEx/HL.GetTokenAttribute for as long as HL.GetEol is false
Also the BaseClass for the Highlighter's data (see AttachToLines) is based on per line storage, and SynEdit's TextBuffer (Lines) do maintenance on this data to keep it synchronized. That is when ever lines of text are inserted or removed, so are entries inserted or removed from the highlighters data (hence it must have one entry per line).
Usually Highlighters store the end-of-line-status in this field. So if the highlighter is going to work on a line, it will continue with the state-entry from the previous line.
SynEdit's folding is handled by unit SynEditFoldedView and SynGutterCodeFolding. Highlighter that implement folding are to be based on TSynCustomFoldHighlighter
The basic information for communication between SynEditFoldedView and the HL requires 2 values stored for each line. (Of course the highlighter itself can store more information):
- FoldLevel at the end of line
- Minimum FoldLevel encountered anywhere on the line
The Foldlevel indicates how many (nested) folds exist. It goes up whenever a fold begins, and down when a fold ends
EndLvl MinLvl Procedure a; 1 - 0 Begin 2 -- 1 - b:= 1; 2 -- 2 -- if c > b then begin 3 --- 2 -- c:=b; 3 --- 3 --- end else begin 3 --- 2 -- b:=c; 3 --- 3 --- end; 2 -- 2 -- end; 0 0 // The end closes both: begin and procedure fold
In the line
Procedure a; 1 - 0
the MinLvl is 0, because the line started with a Level of 0 (and it never went down / no folds closed). Similar in all lines where there is only an opening fold keyword ("begin").
But the line
end else begin 3 --- 2 --
starts with a level of 3, and also ends with it (one close, one open). But since it went down first, the minimum level encountered anywhere on the line is 2.
Without the MinLvl it would not be possible to tell, that a fold ends in this line.
There is no such thing as a MaxLvl, because folds that start and end on the same line can not be folded anyway. No need to detect them.
if a then begin b:=1; c:=2; end; // no fold on that line
Creating a SynEdit Highlighter
Since 0.9.31 Revision 35115 the fold-highlighter has changed. Implementing basic folding is now easier.
All Sources can be found in the Lazarus installation directory under:
The project HighlighterTutorial contains 3 difference example highlighters:
SimpleHl and ContextHl will work with 0.9.30 too
The Basics: Returning Tokens and Attributes
Below is a very basic highlighter for demonstration purposes.
What it does:
- It splits each line into words and spaces (or tabs)
- The spaces are part of the text, and must be highlighted too
- This example does allow to specify different colors for
- - text (defaults to not-highlighted)
- - spaces (defaults to silver frame)
- - words, separated by spaces, that start with a,e,i,o,u (defaults to bold)
- - the word "not" (defaults to red background)
How it works:
The Highlighter creates Attributes that it can return the Words and Spaces.
Is called by SynEdit before a line gets painted (or before highlight info is needed)
- GetTokenEx, GetTokenAttribute, Next, GetEol
Are used by SynEdit to iterate over the Line. Note that the first Token (Word or Spaces) must be ready after SetLine, without a call to Next.
Important: The tokens returned for each line, must represent the original line-text, and be returned in the correct order.
- GetToken, GetTokenPos, GetTokenKind
SynEdit uses them e.g for finding matching brackets. If tokenKind returns different values per Attribute, then brackets only match, if they are of the same kind (e.g, if there was a string attribute, brackets outside a string would not match brackets inside a string)
For readability the highlighter has no optimization, so it may be very slow on larger texts. Many of the supplied highlighters use hash functions, to find what word (or any group of chars) is.
Step 2: Using Ranges
The next example allows content of a line, influences other lines that follows. E.g if a "(*" in pascal makes all following lines a comment until a "*)" is found.
This example extends the Simple HL: The token -- and ++ (must be surrounded by space or line-begin/end to be a token of their own) will toggle words that start with a,e,i,o,u
Multply ++ and -- can be nested. Then for each -- a ++ must be given, before the words highlicht again
Then we extend the scanner. The pre-scan to store the information, calls the same functions than the highlighter, and is automatically called, if anything changes. (It is called for all lines below the changed line, until a line returns the same Range-value as it already had)
The current amoun of "--" is counted in
The amount si decreased by "++"
To store the info we use:
- Called after a line is completely scanned, to get the value at the end of the line. The value will be stored.
- Called before a line get's scanned. Sets the value stored from the end of the previous line.
- Called before the 1st line is scanned (As there is no previous line).
- NOTE: A scan is triggered by *every* change to a line (every keystroke). It scans the current line, and all lines below, until a line returns the same range that it already had.
Step 3: Add Folding
For the example, the highlighter should fold everything between free-standing "-(-", "-)-".
uses SynEditHighlighterFoldBase; ... TSynDemoHl = class(TSynCustomFoldHighlighter)
Change the way range info is stored, since the base class uses it for fold-info
procedure TSynDemoHl.SetRange(Value: Pointer); begin inherited; FCurRange := PtrInt(CodeFoldRange.RangeType); end; procedure TSynDemoHl.ResetRange; begin inherited; FCurRange := 0; end; function TSynDemoHl.GetRange: Pointer; begin CodeFoldRange.RangeType := Pointer(PtrInt(FCurRange)); inherited; end;
And add code to the scanner, for telling the highlighter about opening and closing folds:
procedure TSynDemoHl.FindTokenEnd; begin ... if (FTokenEnd = FTokenPos+1) and (FLineText[FTokenPos] = '[') then StartCodeFoldBlock(nil); if (FTokenEnd = FTokenPos+1) and (FLineText[FTokenPos] = ']') then EndCodeFoldBlock(); end;
- The below is only needed for 0.9.30
Add methods for folding. Those methods deliver the counts as described on the top of this page. (Note that some of this may at some time be done n the bas class.)
public function FoldOpenCount(ALineIndex: Integer; AType: Integer = 0): integer; override; function FoldCloseCount(ALineIndex: Integer; AType: Integer = 0): integer; override; function FoldNestCount(ALineIndex: Integer; AType: Integer = 0): integer; override; function MinimumFoldLevel(Index: Integer): integer; override; function EndFoldLevel(Index: Integer): integer; override;
function TSynDemoHl.FoldOpenCount(ALineIndex: Integer; AType: Integer): integer; begin If AType <> 0 then exit(0); Result := EndFoldLevel(ALineIndex) - MinimumFoldLevel(ALineIndex); end; function TSynDemoHl.FoldCloseCount(ALineIndex: Integer; AType: Integer): integer; begin If AType <> 0 then exit(0); Result := EndFoldLevel(ALineIndex - 1) - MinimumFoldLevel(ALineIndex); end; function TSynDemoHl.FoldNestCount(ALineIndex: Integer; AType: Integer): integer; begin If AType <> 0 then exit(0); Result := EndFoldLevel(ALineIndex); end; function TSynDemoHl.MinimumFoldLevel(Index: Integer): integer; var r: TSynCustomHighlighterRange; begin if (Index < 0) or (Index >= CurrentLines.Count) then exit(0); r := TSynCustomHighlighterRange(CurrentRanges[Index]); if (r <> nil) and (Pointer(r) <> NullRange) then Result := r.MinimumCodeFoldBlockLevel else Result := 0; end; function TSynDemoHl.EndFoldLevel(Index: Integer): integer; var r: TSynCustomHighlighterRange; begin if (Index < 0) or (Index >= CurrentLines.Count) then exit(0); r := TSynCustomHighlighterRange(CurrentRanges[Index]); if (r <> nil) and (Pointer(r) <> NullRange) then Result := r.CodeFoldStackSize else Result := 0; end;
Threads on the forum:
http://www.lazarus.freepascal.org/index.php/topic,11384.msg57160.html#msg57160 (obtaining highlight for printing)