This is nst, the not (so) simple terminal emulator. It is a C++ port of st, the simple terminal emulator for X that sucks less. It is a terminal emulator with focus on security, simplicity, productivity and customizability intended for power users.
I have already been using st for a couple of years. I generally like lean and mean software that is to the point. I also like the principle idea of "one tool for one job", even though the decision not to have scroll support in st could be seen as a little extreme.
Some time ago I looked deeper into st and wanted to understand it better in terms of some functionality and in terms of its security. I soon found that st's codebase is not as simple as the resulting program looks like. On top of this the C programming language, for me personally, does not do the job anymore these days in non-trivial userspace programs.
So I thought why not port this to C++, it's not that big. Well ... it turned out that the original st code was tightly packed in a certain sense and difficult to cut into more digestible pieces. That's what I did in a process of continuous porting and refactoring of the codebase. As a result of some sort of mission creep I also ended up putting together the libcosmos and libxpp libraries in the process (see dependencies below).
The final result is, I would say, a pretty clean C++ codebase that is about a third larger in line count (mostly due to coding style and comments I suppose). The not so simple experience of porting st and a hunch that for some types of people the result is not as simple as before any more, led me to the name of nst for the ported application.
The initial release of nst version 0.9 was mostly a vanilla port of the original st version 0.9. I tried to stay as compatible as was feasible. Some minor changes in the command line behaviour exist there. I possibly fixed some edge cases and most likely introduced some new bugs in the process of porting, as is practically unavoidable.
The one major change is in portability, since I decided to rely on libcosmos, which is Linux only. Thus, other UNIX like operating systems are currently out of the picture for nst.
The compile time configuration via the config header still exists in
nst_config.hxx. The configuration style in the header changed quite a bit,
naturally, due to the change of the programming language. I did not test much
else than the default configuration yet, though. I believe that also the
original st still has a couple of issues lingering in less tested
configurations.
Beginning with nst version 1.0 I started to give this project a more
individual touch. My aim is to find a balance between a slim terminal emulator
and enough features to avoid having to rely on other complex programs. For
example, I don't want to run a terminal multiplexer like tmux or screen
just to get scrollback support. These programs are very complex, consisting of
multiple tens of thousand lines of code. For this reason nst version 1.0 now
contains features for a history scrollback buffer and for processing the
history in external programs for searching. I also added some more logic in
the area of automatic selection expansion for better productivity. The major
feature additions are explained in more detail in the following sections.
The scroll program, which is also offered on http://suckless.org, was supposed to become a small standalone utility to provide scroll support on top of st. By now its authors noticed that its design has some limits, though, that are hard to overcome. Therefore I took the route to implement scrollback support internally.
Starting with nst version 1.0 the terminal emulator offers builtin scrollback support, mostly in the spirit of original st's scrollback ring buffer patch.
I did not implement the reflow patch though. Reflow is the process of rearranging automatic line breaks, when the terminal window size changes. The patch for this seemed too complex for what this feature gains.
Instead I chose a simpler approach: What I want to avoid is losing information when making the emulator window smaller (and thus cutting off long lines). This is something that can quickly happen as a side effect of using a tiling window manager like i3, where automatic resizing of windows is an integral part of the user workflow. To avoid such information loss, I implemented a simpler logic, so that columns are never discarded upon window resize, except if the line is overwritten in the history buffer. This way, when the window size is increased again, the previous columns will appear again and no information is lost.
This approach is not perfect, as lines can become inconsistent if programs are manipulating the content of already existing lines, while previous columns are still hidden due to a smaller window size. When increasing the window size again then old columns appear that no longer match the current line content. It would be difficult and inefficient to catch all code paths where line content is changed to then discard hidden columns.
The problem is not very severe in practice though. Programs that modify line content programmatically are usually running on the alternative screen, where this logic is disabled and where there is no scrollback buffer.
Once scrollback history is available, it would be really nice to support
searching in it, to find specific older data. Doing this internally in the
terminal emulator is a real pain in terms of complexity though. It requires
string processing, regular expressions, additional input handling and also
some form of a status and command display to make the current search state
visible to the user. All of this just to implement logic that already
exists in much more powerful tools like grep on the command line or a fully
fledged editor like vim.
Therefore I decided just to add interfaces to nst to allow feeding the existing buffer text to external programs. There are two mechanisms available:
- You can pipe the complete terminal buffer contents to an external program
via a special keyboard shortcut (ctrl-shift-b by default). The
configuration for this is found in the
open_buffer_in_editor_cmdlineconfiguration file setting. By defaultgvimis opened. - The separate
nst-msgutility can be used to access the terminal buffer contents of the currently running terminal emulator. This can be used to construct command lines on the fly likenst-msg -d | grep mystring. Since the output of the utility modifies the terminal buffer itself it can be confusing when multiple subsequent searches are performed this way. Therefore the utility allows to take a snapshot of the current terminal contents and operate on them, until a new snapshot is created.
nst implements the following text selection enhancements:
- a double-click on a URI scheme like
http://will select the complete URL. SeeSEL_URI_SCHEMESinnst_config.hxxandselection_uri_schemesin the configuration file. - a double-click on a word delimiting character, while pressing MOD1 (
alt), will select the following word up until the next delimiter of the same kind. E.g. when clicking on the double quotes of"a couple of words"then the complete string delimited by the double quotes will be selected. When double-right-clicking on a word delimiting character, then a backward search for the same delimiter is performed. In both cases, if nothing is found, nothing is selected. The start/end of line count as matching delimiting characters. - if a word selection already exists and a left or right click occurs,
while pressing MOD1 (
alt), then the selection will be expanded to the left, to the right, or in both directions. Expansion to the left happens when the click is above or left of the existing selection. Expansion to the right happens when the click is below or right of the existing selection. Expansion in both direction happens when the click is on the existing selection itself. - selecting text while holding CONTROL and MOD1 (
alt), will select full lines between the selected start and end coordinates.
Starting with version 1.0 the more common nst options can now be influenced
via the nst.conf(5) configuration file. The defaults can still be configured
via the nst_config.hxx header. The configuration file will be looked up
during startup, though, and can override the compiled in defaults.
For st a range of patches is available, from which I selected a subset and ported them to nst:
- different color schemes are configurable via the
nst_config.hxxheader and thethemeconfiguration file option. - inverting the color scheme using a keyboard shortcut.
- support for hiding the mouse cursor on keyboard input.
- support for a keyboard shortcut to enter full screen mode.
- support for a
REVERSE_BLOCKcursor style that inverts the color of the Glyph the cursor sits on. - support for CSI 22/23 title stack operations that allow to save and restore window titles.
- blinking cursor implementation is now working.
nst depends on the X libraries like the original st. Further it depends on the libcosmos and libxpp C++ helper libraries. These libraries are integrated via Git submodules into this repository and are statically linked, so you shouldn't need to worry a lot about them.
For command line parsing the TCLAP header-only library is used, which is also pulled in as a Git submodule.
nst uses the SCons build system. See
libcosmos's README
for some hints about how to use it. In the default case simply run
scons install
and you will find all installation artifacts in the install directory tree.
Because the libcosmos and libxpp dependencies don't have a stable ABI
concept yet, the linking is done statically for them by default. So you don't
have to worry about setting up the shared library path etc. For packaging you
can still build against shared libraries by passing libtype=shared to SCons.
Starting with version 1.0 nst now uses its own terminal identifier string
and installs terminfo files distinct from st's terminfo files. This is to
avoid conflicts between the original st and nst. To install the terminfo
files locally into your home directory, run scons terminfo_user. Otherwise
the terminfo files are installed into the installation tree and can be
packaged for system wide installation.
The support for nst can be worse than the support for the original st in
some places, if software does not properly use terminfo to identify terminal
features, but relies on the terminal identification string found in the
$TERM environment variable instead.
nst - to my knowledge - is currently packaged for the following Linux distributions:
- openSUSE Tumbleweed
- Arch Linux AUR: shared build, static build
I tried to document the workings of the terminal as best as I could in the ported code. The smaller pieces and increased isolation of some code portions should also make things clearer. The C++ code does not rely much on the more nasty language features like templates, it only uses some template classes from other libraries.
nst uses Doxygen inline source comments that can either be viewed
as plaintext directly in the sources or can be generated by building scons doxygen, provided you have the Doxygen program installed on your system.
Otherwise you can find the generated HTML version of the API documentation on the related GitHub Page.
I performed fuzzing with AFL++, feeding fuzzed input to Term::write(). This
mostly covers the various escape sequences and their robustness. If found a
few corner cases this way that could be fixed. For more details check out the
"afl" branch and the "README.fuzzing" there.
With version 1.1 of nst I have reached the feature set, stability and code quality that I had in mind.
Any bugfixes and improvements are welcome as pull requests. Keep in mind st's LEGACY philosophy. The basic idea of a slim and robust terminal program should remain, but finding a middle path to cover typical user requirements is also good for me. Please refer to the coding style for a rough style guide. Before working on larger changes it might be helpful to contact me first to reach some common ground regarding the design etc.
By contributing you accept the same licensing conditions as the rest of the project for your contribution. Your name will be added to an authors list in the repository.
Based on the original st source code which in turn is based on Aurélien APTEL bt source code.