Difference between revisions of "Lazarus Examples Window"

From Lazarus wiki
Jump to navigationJump to search
(Example Management Tool, EMT)
(Other Examples)
 
(45 intermediate revisions by the same user not shown)
Line 2: Line 2:
  
  
This wiki page is an attempt to capture people's thoughts wrt replacing the existing Examples Window in the Lazarus IDE.
+
The new Example Window that exists in Lazarus 3.0 and beyond is documented below.
  
* Its based on this forum thread - https://forum.lazarus.freepascal.org/index.php/topic,57680.0.html
+
== For the end user ==
* Its (hopefully only initially) one person's view of the discussion.
+
===Introduction===
* It has a limited life, no need for it to exist after the matter is resolved (or abandoned).
+
A Lazarus user gets to the Example Window after clicking the button on the Project Wizard screen or from the Tools Menu, "Example Projects". In either case you see a window offering a list of known examples. The list can be filtered by key words or by category (double click between category checkboxes turns all off). In basic use, it shows you all the examples shipped with Lazarus.  
  
 +
The Example Window will allow you to open, build (and edit) and run any example but note some have specific package requirements. When opened, the examples from the Lazarus Source code are copied to a (user writable) area in the Lazarus Config directory ([[pcp|PCP]]) because, on some systems Lazarus Source is in read-only disk space.
  
== Why is there a problem ? ==
+
Feel free to edit or make changes to examples in Lazarus Source, if you totally mess up, its easily refreshed from the Examples Window.
  
The existing Examples system has issues, perhaps in that it has not keep up Lazarus's own rapid development. There are a number of issues identified (in no particular order) -
+
===Examples in Packages===
* Linux Lazarus installs based on (distro) Packages have the Examples in read only space.
+
When you install a package that has compliant examples, they will also appear in the Lazarus Examples Window. If they don't appear, the most likely reason is that they do not have an example meta data file. See below.
* Most Examples do not have any indication of the topic covered other than file/project name.
 
* Examples don't have a category system identifying who target audience is, beginner to advanced user.
 
* Many examples are outdated, many don't, for example use the Lazarus Form Designer confusing new users who expect to see Object Inspector content.
 
* The system is limited to only those examples shipped in the main Lazarus distribution, cannot cover eg Examples applicable to OPM.
 
  
 +
===Displaying your own Examples===
 +
If you have your own examples in one or more Lazarus projects, you can arrange to have them listed along with the built in examples supplied with Lazarus. Following the same rules as below, you would -
 +
* Ensure each example is in its own directory and is self contained.
 +
* Provide meta data files as described below. Perhaps set the category to something like "Private" ?
 +
* Add an entry to the ./examples/examples.txt file in your Lazarus Source directory. The entry, see the existing ones, should have a relative path from the top of the lazarus source directory to your meta data file. If you are using a packaged version of Lazarus then this examples.txt file might be in read only space and you will need administrative access to it.
 +
* Examples mentioned in examples.txt are always copied to a work area ensuring write access and allowing you to play without affecting the original.
  
== What should the user experience be like ? ==
+
===FPC Examples===
 +
FPC also provides a number of examples relating to its packages and RTL. These examples are generally command line driven and don't have the Lazarus project information so are unsuited to working with the Lazarus Examples Window. (It might be nice to find a way to display them however.)
  
* A user should be able to choose to see content appropriate to their experience.
+
== For the Developer ==
* Be able to see a summary of what an Example is about before opening it.
 
* Be able to open an Example, have a play with it, make a few changes and recompile to see what happens. Maybe roll back to the original Example if they make a full mess of it.
 
* Examples should be generally short, contain appropriate, relevant code focused on one topic each. But there will me many exceptions to that.
 
* If a user installs a third party package, eg via OPM, then any examples it contains should be treated in the same manner.
 
* Be useful to allow a user to browse through example content while working on a real project, copy and past a snipit as required.
 
  
 +
=== Examples in the Lazarus Source ===
  
== How do we achieve this ? ==
+
You can add an example anywhere you like in the Lazarus Source Tree, there are lots under ~/examples but also many associated with different Lazarus sub system. A few rules apply -
  
There appears to be three key steps, reviewing all existing Examples, adding meta data and redesigning the Examples Window is clearly necessary. A reasonably easy to work with metadata standard will ensure ongoing performance. Ensuring that standard is complied with in new Examples may be more than we should ask Lazarus Developers to be responsible for.  
+
* The Example Name must be unique within Lazarus (when lowercased).
 +
* The example should be self contained within its own directory. That directory (and any sub directories) will be copied to the work area so don't assume particular files are "just up one dir".
 +
* The example should have an Example Metadata File, with a file name that corresponds to the project name and an extension of .ex-meta. The content of this file is JSON and must have a name, a category and should have a (multiline) description and keywords. See below.
  
Third party packages is a grey area, many do not have examples at all (so be it), some will have Examples that can work with a proposed new system with just the addition of a metadata file. There will be situations where a "forth party" will produce an Example without the cooperation of the package author.
+
If you add a new example (or remove one) to the Lazarus Source Tree, the file ~/examples/examples.txt needs to be refreshed. Its plain text, edit it directly or generate a new one with this command (on a *nix )-
  
We also need to keep in mind that by distributing, indexing or referring to Examples, we take on some Duty of Care to ensure that no Example contains malicious code and, perhaps, is Fit for Purpose.  
+
$> find . -name "*.ex-meta" > examples/examples.txt
  
That is about all we all agree on at present !
+
=== Examples in Third Party Packages ===
 +
Again, you are free to place your package examples directory where you like but in order for the Lazarus Examples Window to find it, some things must be provided, note, different rules than above !
  
 +
* The package must be currently installed in Lazarus (check ? see if its listed in ([[pcp|PCP]])/staticpackages.inc)
 +
* Your example should be in a directory of its own. You should not put more than one example in the same directory.
 +
* In the case of Package Examples, the example directory is not moved to a work area so it can (but perhaps should not) be dependent on local, relative path files.
 +
* It must have a Metadata File, see below.
 +
* The Package file, that is the .lpk file must have entry such as <ExamplesDirectory Value="../demo"/>, typically just below the Author item. The value is the relative path from the .lpk file to a directory containing your example or examples. eg -
 +
[MyPackage]
 +
    [demo]
 +
        mypackage_demo1.ex-meta
 +
        ....
 +
        [demo2]
 +
            mypackage_demo2.ex-meta
 +
            ....
 +
    [package]
 +
        mypackage.lpk
  
== Methodology ==
+
(Personally, I would put demo1 in its own directory too but the above would work !)
  
 +
Note that, at present, Lazarus, when making a package, does NOT create the ExamplesDirectory entry, it will, but its a work in progress. If you want to test, manually adding that entry is the way to go right now.
  
There appears to be two broad models available, each with their own advantages and disadvantages. Choosing one or the other model and determining what our metadata file looks like is the next phase.
+
=== The Metadata File ===
  
Its likely that the metadata design is substantially the same either model.
+
{{Note| If you add a new example (or remove one) to the Lazarus Source Tree, the file ~/examples/examples.txt needs to be refreshed. Its plain text, edit it directly or generate a new one with this command from the top level Lazarus directory (on a *nix )-
  
Both Example Model will require -
+
$> find . -name "*.ex-meta" > examples/examples.txt
* An extensive review of all existing Examples is required (for both models).  
+
}}
* Additional of a metadata file.
 
* A call for more Examples.
 
* A means to scan for 'other' Examples, such as ones in OPM packages.
 
  
=== Examples Remain in Distribution. ===
+
All examples that appear in the Example Window have a json metadata file with an extension ".ex-meta" in the top level directory of the example (not the package). Without a valid metadata file, the example will not be listed in the Example Window. An individual example project file would look like this -
 
 
This is the KISS solution, it involves the least structural change but may not necessarily involve less work. As well as reviewing and adding meta data, we may wish to re-organize the location of packages. The extensive changes that must happen to the existing Examples will need Lazarus Developer involvement.
 
 
 
More to come
 
 
 
 
 
=== Examples move on-line ===
 
 
 
Possibly a simpler change because much of it is implemented externally, at some stage the Examples Window will need to be changed in the Lazarus Distro but lots of building, adjusting of existing Examples, testing can happen without annoying Lazarus Developers.
 
 
 
Prototype code to download files, index projects and build a master metadata file already exists.
 
 
 
A very rough and ready '''example example repository''' has been established at https://gitlab.com/dbannon/laz_examples
 
 
 
Note that you can browse the repository, just looking for snipits of code, you can download a particular Example directory as a zip file and use it locally. This is perhaps, for many users, easier than closing their existing project, opening up the example, seeing what they are looking for and going back to their real project and continuing working. But you need online access....
 
 
 
An application now exists that makes creating and managing the metadata files. We'll call it EMT, Example Management Tool, https://gitlab.com/dbannon/laz_examples/-/tree/main/Utility/ExScanner . It will copy a project's files into a ready to push git directory. The process is -
 
 
 
* Check the default directories in EMT, they are set to suit me, probably not you !
 
 
 
* In EMT, press the Set button and point to the directory containing the example you plan to test and process. Important you do this before compiling the project otherwise you will be trying to add compiled binary files.
 
 
 
* Open that project in Lazarus, make sure it works, does what it appears to claim to do and if all OK, fill in the meta data in EMT, if the project has a readme.txt file, use at least some of its content. Click Save.
 
 
 
EMT will also allow you the directly edit a metadata file and save it back where it came from. And it incorporates a draft Examples Windows, a prototype of what may go into Lazarus eventually.
 
 
 
== The Meta Data File ==
 
It has been suggested we need a 'proper' metadata file format, either xml or json.  My preference is json and I suggest that an individual example project file would look like this -
 
  
 
<syntaxhighlight lang=text>{  
 
<syntaxhighlight lang=text>{  
Line 87: Line 74:
 
     "Category" : "Beginner",
 
     "Category" : "Beginner",
 
     "Keywords" : ["Lazarus", "Hello World", "TButton", "TMemo"],
 
     "Keywords" : ["Lazarus", "Hello World", "TButton", "TMemo"],
     "Description" : "This might be your first Lazarus project, its the traditional Hell World.  Two buttons have been dropped on the form, renamed and their captions set. A memo was then added and each button was double clicked and what they are expected to do was set."
+
     "Description" : "This might be your first Lazarus project, its the traditional Hello World.  Two buttons have been dropped on the form, renamed and their captions set. A memo was then added and each button was double clicked and what they are expected to do was set."
 
}</syntaxhighlight>
 
}</syntaxhighlight>
  
 
In this case, the example project files would be in a subdirectory called laz_hello, same spelling but all lowercase consistent with Lazarus.  
 
In this case, the example project files would be in a subdirectory called laz_hello, same spelling but all lowercase consistent with Lazarus.  
  
And by extension, the master.ex-meta file, regenerated frequently and downloadable from the repo to be cached locally would look like this -
+
The three fields are free form text, there is no dictionary so, you are free to introduce both new Categories and new Key Words. Its desirable that we do not have too many Categories so, perhaps consider posting a message on the forum before using a new one ? At present, the following Categories are in use -
<syntaxhighlight lang=text>{
+
* Beginner
"LastUpDate" : "2021-10-19T11:44:41+11:00",
+
* General
 +
* TAChart
 +
* DBase
 +
* LazReport
 +
* ThirdParty
 +
 
 +
There is a rough and ready GUI app to make, edit and importantly, validate metadata files available at https://github.com/davidbannon/ExampleMetaData .
 +
 
 +
=== Can the IDE find the example ?===
  
"Beginner/laz_hello" : {
+
If the IDE does not find an example, some things to check for -
    "Name" : "Laz_Hello",
 
    "Category" : "Beginner",
 
    "Keywords" : ["Lazarus", "Hello World", "TButton", "TMemo"],
 
    "Description" : "This might be your first Lazarus project, its the traditional Hello World.  Two buttons have been dropped on the form, renamed and their captions set. A memo was then added and each button was double clicked and what they are expected to do was set.",
 
  
"Components/listview" : {
+
* Does it have a metadata file ?
    "Name" : "ListView",
+
* Is there a message about the metadata from console ?
    "Category" : "Components",
+
* If its a Lazarus Source example, is it mentioned in examples/examples.txt ?
    "Keywords" : ["TListView", "grid", "needs work"],
+
* if a Package Example, is it mentioned in ([[pcp|PCP]])/staticpackages.inc ? and in ([[pcp|PCP]])/packagefiles.xml ? (Unlike the examples.txt file, do not manually edit these files, they should be updated when a package is installed into the the IDE.)
    "Description" : "A project that demonstrates some of a TListView's capabilities. Not so much a \"how to use\" as an exerciser of capabilities. Note, entering an invalid column number triggers a crash."
 
  
}</syntaxhighlight>
+
==Notes==
 +
The user can view the project content and, if they choose, build the project. Later, if the user users the Example Window to again open that project, they will be asked if they want to refresh it, doing so will erase any false edits they may have made.
  
Note the date in ISO format, overall, the file is still reasonably human readable. And now, of course, its easily extendable. We could add a format version but I don't consider it necessary.
+
Important to note -
 +
* Example Projects will not be displayed in the Examples Window unless they have a valid metadata file. An error is dropped to the console if a metadata file with bad json is encountered.
 +
* The original copy of the Example is not altered when the Example Window is used to open an Example. So, play away !
 +
* New examples can, potentially be added via the normal Gitlab pull request system.
 +
* When examples are added to or removed from the Lazarus Source, changes need be made to the (eg) ~/lazarus_3_0/examples/examples.txt file. See the Metadata section.
 +
* Examples demonstrating aspects of third party packages are probably best added to that package rather than to Lazarus itself.
  
 
== See also ==
 
== See also ==
Line 117: Line 113:
 
* https://gitlab.com/freepascal.org/lazarus/lazarus/-/issues/37509
 
* https://gitlab.com/freepascal.org/lazarus/lazarus/-/issues/37509
 
* https://gitlab.com/dbannon/laz_examples - this is just a temp home.
 
* https://gitlab.com/dbannon/laz_examples - this is just a temp home.
 +
* https://gitlab.com/dbannon/laz_examples/-/tree/main/Utility/ExScanner - a tool for manipulating Example Projects in and around the Lazarus Src Tree. Probably past its use by date. Also has a framework to 'exercise' the Lazarus Examples Window in a stand alone, easier to manage environment.
 +
* https://github.com/davidbannon/ExampleMetaData - a very simple editor to make and validate the Example Meta Data files.
 +
* https://gitlab.com/freepascal.org/lazarus/lazarus/-/blob/main/components/exampleswindow/uexampledata.pas the unit making decisions about your examples.
 +
  
  

Latest revision as of 02:33, 28 January 2024


The new Example Window that exists in Lazarus 3.0 and beyond is documented below.

For the end user

Introduction

A Lazarus user gets to the Example Window after clicking the button on the Project Wizard screen or from the Tools Menu, "Example Projects". In either case you see a window offering a list of known examples. The list can be filtered by key words or by category (double click between category checkboxes turns all off). In basic use, it shows you all the examples shipped with Lazarus.

The Example Window will allow you to open, build (and edit) and run any example but note some have specific package requirements. When opened, the examples from the Lazarus Source code are copied to a (user writable) area in the Lazarus Config directory (PCP) because, on some systems Lazarus Source is in read-only disk space.

Feel free to edit or make changes to examples in Lazarus Source, if you totally mess up, its easily refreshed from the Examples Window.

Examples in Packages

When you install a package that has compliant examples, they will also appear in the Lazarus Examples Window. If they don't appear, the most likely reason is that they do not have an example meta data file. See below.

Displaying your own Examples

If you have your own examples in one or more Lazarus projects, you can arrange to have them listed along with the built in examples supplied with Lazarus. Following the same rules as below, you would -

  • Ensure each example is in its own directory and is self contained.
  • Provide meta data files as described below. Perhaps set the category to something like "Private" ?
  • Add an entry to the ./examples/examples.txt file in your Lazarus Source directory. The entry, see the existing ones, should have a relative path from the top of the lazarus source directory to your meta data file. If you are using a packaged version of Lazarus then this examples.txt file might be in read only space and you will need administrative access to it.
  • Examples mentioned in examples.txt are always copied to a work area ensuring write access and allowing you to play without affecting the original.

FPC Examples

FPC also provides a number of examples relating to its packages and RTL. These examples are generally command line driven and don't have the Lazarus project information so are unsuited to working with the Lazarus Examples Window. (It might be nice to find a way to display them however.)

For the Developer

Examples in the Lazarus Source

You can add an example anywhere you like in the Lazarus Source Tree, there are lots under ~/examples but also many associated with different Lazarus sub system. A few rules apply -

  • The Example Name must be unique within Lazarus (when lowercased).
  • The example should be self contained within its own directory. That directory (and any sub directories) will be copied to the work area so don't assume particular files are "just up one dir".
  • The example should have an Example Metadata File, with a file name that corresponds to the project name and an extension of .ex-meta. The content of this file is JSON and must have a name, a category and should have a (multiline) description and keywords. See below.

If you add a new example (or remove one) to the Lazarus Source Tree, the file ~/examples/examples.txt needs to be refreshed. Its plain text, edit it directly or generate a new one with this command (on a *nix )-

$> find . -name "*.ex-meta" > examples/examples.txt

Examples in Third Party Packages

Again, you are free to place your package examples directory where you like but in order for the Lazarus Examples Window to find it, some things must be provided, note, different rules than above !

  • The package must be currently installed in Lazarus (check ? see if its listed in (PCP)/staticpackages.inc)
  • Your example should be in a directory of its own. You should not put more than one example in the same directory.
  • In the case of Package Examples, the example directory is not moved to a work area so it can (but perhaps should not) be dependent on local, relative path files.
  • It must have a Metadata File, see below.
  • The Package file, that is the .lpk file must have entry such as <ExamplesDirectory Value="../demo"/>, typically just below the Author item. The value is the relative path from the .lpk file to a directory containing your example or examples. eg -
[MyPackage]
    [demo]
        mypackage_demo1.ex-meta
        ....
        [demo2]
            mypackage_demo2.ex-meta
            ....
    [package]
        mypackage.lpk

(Personally, I would put demo1 in its own directory too but the above would work !)

Note that, at present, Lazarus, when making a package, does NOT create the ExamplesDirectory entry, it will, but its a work in progress. If you want to test, manually adding that entry is the way to go right now.

The Metadata File

Light bulb  Note: If you add a new example (or remove one) to the Lazarus Source Tree, the file ~/examples/examples.txt needs to be refreshed. Its plain text, edit it directly or generate a new one with this command from the top level Lazarus directory (on a *nix )-

$> find . -name "*.ex-meta" > examples/examples.txt

All examples that appear in the Example Window have a json metadata file with an extension ".ex-meta" in the top level directory of the example (not the package). Without a valid metadata file, the example will not be listed in the Example Window. An individual example project file would look like this -

{ 
"Laz_Hello" : {
    "Category" : "Beginner",
    "Keywords" : ["Lazarus", "Hello World", "TButton", "TMemo"],
    "Description" : "This might be your first Lazarus project, its the traditional Hello World.  Two buttons have been dropped on the form, renamed and their captions set. A memo was then added and each button was double clicked and what they are expected to do was set."
}

In this case, the example project files would be in a subdirectory called laz_hello, same spelling but all lowercase consistent with Lazarus.

The three fields are free form text, there is no dictionary so, you are free to introduce both new Categories and new Key Words. Its desirable that we do not have too many Categories so, perhaps consider posting a message on the forum before using a new one ? At present, the following Categories are in use -

  • Beginner
  • General
  • TAChart
  • DBase
  • LazReport
  • ThirdParty

There is a rough and ready GUI app to make, edit and importantly, validate metadata files available at https://github.com/davidbannon/ExampleMetaData .

Can the IDE find the example ?

If the IDE does not find an example, some things to check for -

  • Does it have a metadata file ?
  • Is there a message about the metadata from console ?
  • If its a Lazarus Source example, is it mentioned in examples/examples.txt ?
  • if a Package Example, is it mentioned in (PCP)/staticpackages.inc ? and in (PCP)/packagefiles.xml ? (Unlike the examples.txt file, do not manually edit these files, they should be updated when a package is installed into the the IDE.)

Notes

The user can view the project content and, if they choose, build the project. Later, if the user users the Example Window to again open that project, they will be asked if they want to refresh it, doing so will erase any false edits they may have made.

Important to note -

  • Example Projects will not be displayed in the Examples Window unless they have a valid metadata file. An error is dropped to the console if a metadata file with bad json is encountered.
  • The original copy of the Example is not altered when the Example Window is used to open an Example. So, play away !
  • New examples can, potentially be added via the normal Gitlab pull request system.
  • When examples are added to or removed from the Lazarus Source, changes need be made to the (eg) ~/lazarus_3_0/examples/examples.txt file. See the Metadata section.
  • Examples demonstrating aspects of third party packages are probably best added to that package rather than to Lazarus itself.

See also