xxh/README.md

162 lines
12 KiB
Markdown
Raw Normal View History

2020-03-09 22:23:17 +00:00
<p align="center">You chosen a command shell and spent months to stuffed it with shortcuts and colors. But when you move from local to remote host using ssh you lose it all. The mission of xxh is to bring your favorite shell wherever you go through the ssh.</p>
2020-03-29 13:51:13 +00:00
<p align="center">No installations or root access on the host required.</p>
2020-02-08 23:03:26 +00:00
<p align="center">
2020-03-14 07:51:21 +00:00
<a href="https://pypi.org/project/xxh-xxh/" target="_blank"><img src="https://img.shields.io/pypi/v/xxh-xxh.svg" alt="[release]"></a>
2020-03-14 12:05:33 +00:00
<a href="https://gitter.im/xxh-xxh/community?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge" target="_blank"><img alt="[gitter chat]" src="https://badges.gitter.im/xxh-xxh/community.svg"></a>
2020-03-14 07:51:21 +00:00
<img alt="[BSD license]" src="https://img.shields.io/pypi/l/xxh-xxh">
2020-02-08 23:03:26 +00:00
</p>
2020-03-22 11:35:26 +00:00
<p align="center">
If you like the idea of xxh click ⭐ on the repo and spread the word.
</p>
2019-11-03 15:13:42 +00:00
2020-03-22 10:07:08 +00:00
## Installation methods
2020-03-27 19:17:21 +00:00
#### PyPi 3
2020-03-14 11:59:58 +00:00
```shell script
2020-03-24 11:34:58 +00:00
pip3 install -U xxh-xxh
2019-11-04 08:58:11 +00:00
```
2020-03-27 19:17:21 +00:00
#### Linux portable binary
```
mkdir ~/xxh && cd ~/xxh
wget https://github.com/xxh/xxh-portable/raw/master/result/xxh-portable-musl-alpine-Linux-x86_64.tar.gz
tar -xzf xxh-portable-musl-alpine-Linux-x86_64.tar.gz
./xxh
```
2020-03-22 10:07:08 +00:00
#### AppImage
```
mkdir ~/xxh && cd ~/xxh
2020-03-28 10:50:52 +00:00
wget -O xxh https://github.com/xxh/xxh-appimage/releases/download/continuous/xxh-release-x86_64.AppImage
2020-03-27 19:46:32 +00:00
chmod +x xxh && ./xxh
2020-03-22 10:07:08 +00:00
```
2020-03-27 17:03:14 +00:00
To use seamless mode run `./xxh ++extract-sourcing-files` to extract `xxh.*sh` files to the current directory then run `source xxh.zsh myhost` command for seamless connecting.
2020-03-19 06:19:13 +00:00
2020-03-22 10:45:17 +00:00
## Supported shells
2020-03-29 09:12:08 +00:00
| xxh-shell-`...` | status | seamless | plugins | demo |
|-----------------------------------------------------------------------|------------|-------------|---------|------|
2020-03-30 12:55:22 +00:00
| **[xonsh-appimage](https://github.com/xxh/xxh-shell-xonsh-appimage)** | stable | `xxh.xsh` | [pipeliner](https://github.com/xxh/xxh-plugin-xonsh-pipe-liner), [bar](https://github.com/xxh/xxh-plugin-xonsh-theme-bar), [autojump](https://github.com/xxh/xxh-plugin-xonsh-autojump), [sample](https://github.com/xxh/xxh-plugin-xonsh-sample) | <a href="https://asciinema.org/a/osSEzqnmH9pMYEZibNe2K7ZL7" target="_blank"><img alt="[demo xonsh]" src="https://img.shields.io/badge/demo-xonsh-grass"></a> |
| **[zsh](https://github.com/xxh/xxh-shell-zsh)** | stable | `xxh.zsh` | [ohmyzsh](https://github.com/xxh/xxh-plugin-zsh-ohmyzsh), [p10k](https://github.com/xxh/xxh-plugin-zsh-powerlevel10k), [sample](https://github.com/xxh/xxh-plugin-zsh-sample) | <a href="https://asciinema.org/a/rCiT9hXQ5IdwqOwg6rifyFZzb" target="_blank"><img alt="[demo zsh]" src="https://img.shields.io/badge/demo-zsh-grass"></a> |
| **[fish](https://github.com/xxh/xxh-shell-fish)** | prestable | | [sample](https://github.com/xxh/xxh-plugin-fish-sample) | |
2020-03-30 12:55:59 +00:00
| **[bash-zero](https://github.com/xxh/xxh-shell-bash-zero)** | prestable | `xxh.bash` | [ohmybash](https://github.com/xxh/xxh-plugin-bash-ohmybash), [vim sample](https://github.com/xxh/xxh-plugin-bash-vim) | <a href="https://asciinema.org/a/314508" target="_blank"><img alt="[demo bash]" src="https://img.shields.io/badge/demo-bash-grass"></a> |
2020-03-29 09:12:08 +00:00
| **[osquery](https://github.com/xxh/xxh-shell-osquery)** | beta | | | |
| **[fish-appimage](https://github.com/xxh/xxh-shell-fish-appimage)** | alpha | | | |
2020-03-22 11:43:26 +00:00
2020-03-29 12:43:06 +00:00
The "zero" means the shell installed on host will be used.
2020-03-24 19:33:10 +00:00
2020-03-22 11:43:26 +00:00
[Search xxh shell on Github](https://github.com/search?q=xxh-shell&type=Repositories) or [Bitbucket](https://bitbucket.org/repo/all?name=xxh-shell) or [create your shell entrypoint](https://github.com/xxh/xxh-shell-sample) to use another portable shell.
2020-03-22 10:45:17 +00:00
## Usage
Use `xxh` as replace `ssh` to connecting to the host without changing ssh arguments:
2020-03-14 12:01:51 +00:00
```
2020-03-22 10:45:17 +00:00
xxh <host from ~/.ssh/config>
xxh [ssh arguments] [user@]host[:port] [xxh arguments]
xxh [+I xxh-package ...] [+L] [+RI xxh-package ...] [+R xxh-package ...]
2019-11-03 14:34:38 +00:00
```
2020-03-22 10:45:17 +00:00
Common examples (use `xxh --help` to get info about arguments):
2020-03-28 21:01:32 +00:00
```yaml
2020-03-22 10:45:17 +00:00
xxh myhost # connect to the host
xxh -i id_rsa -p 2222 myhost # connect using key and port
xxh myhost +s zsh # connect to the host into zsh shell
source xxh.zsh myhost +I xxh-plugin-zsh-ohmyzsh # install zsh plugin then connect into zsh with seamless mode (zsh theme name will be add from local host)
2020-03-27 16:58:28 +00:00
xxh myhost +s xonsh-appimage +I xxh-plugin-xonsh-theme-bar # install xonsh plugin before connect into xonsh shell
2020-03-22 10:45:17 +00:00
xxh myhost +s bash-zero +I xxh-plugin-bash-vim # install bash plugin before connect
xxh myhost +if +q # install without questions in quiet mode
xxh myhost +hh /tmp/xxh +hhr # upload xxh to myhost:/tmp/xxh and remove it after disconnect
```
2020-03-28 10:20:34 +00:00
To reusing arguments there is `~/.config/xxh/config.xxhc` (`$XDG_CONFIG_HOME`) [yaml](https://en.wikipedia.org/wiki/YAML) config:
2020-03-14 11:59:58 +00:00
```yaml
2020-03-11 10:47:09 +00:00
hosts:
2020-03-13 13:46:41 +00:00
myhost: # settings for myhost
-p: 2222 # set special port
2020-03-22 10:45:17 +00:00
+s: xxh-shell-zsh # use zsh shell
+I: xxh-shell-zsh # install xxh-shell before connect
2020-03-22 09:26:10 +00:00
+I: xxh-plugin-zsh-ohmyzsh # install xxh-plugin before connect
2020-03-13 13:50:31 +00:00
+e: ZSH_THEME="clean" # set ohmyzsh theme
2020-03-28 08:17:06 +00:00
+hhh: "~" # use user default home directory on host (/home/user instead of /home/user/.xxh)
2020-03-11 10:47:09 +00:00
2020-03-11 10:52:36 +00:00
"company-.*": # for all hosts by regex pattern
+if: # don't asking about install (++install-force)
2020-03-27 16:58:28 +00:00
+s: xonsh-appimage # use xonsh shell
2020-03-11 10:52:36 +00:00
+hh: /tmp/.xxh # use special xxh home directory (++host-xxh-home)
2020-03-14 11:44:51 +00:00
+hhr: # remove host xxh home after disconnect (++host-xxh-home-remove)
2020-03-11 10:47:09 +00:00
```
2020-03-22 10:45:17 +00:00
The arguments will be automatically added when you run `xxh myhost` or `xxh company-server1`.
If you add `+I` arguments with appropriate xxh packages (customizations described in development section) you can make your config file complete and simplify the usage command to `xxh myhost`. All xxh packages will be installed automatically.
2020-02-16 17:17:07 +00:00
2020-03-15 18:35:48 +00:00
## The ideas behind xxh
2020-03-29 13:51:57 +00:00
* **Portable**. By default building occurs locally and then xxh uploads the result to host. No installations or root access on the host required. The security and careful about environment on the host are behind it.
2020-03-28 11:22:13 +00:00
* **Careful**. No blindfold copying config files from local to remote host. The privacy and repeatability reasons are behind it. Every xxh package, shell or plugin is the bridge that use only what required, no more.
* **Hermetic**. If you delete `~/.xxh` directory from the remote host then xxh has never been on the host. If files appears outside xxh home directory feel free to report about this cases.
* **Fork-ready**. Every repo could be forked, customized and used without waiting of package management system, xxh releases or any third party.
2020-03-15 18:38:05 +00:00
* **Do more**. The xxh packages are not only about shells. Any type of tool or code could be behind "shell entrypoint". If you want to play Super Mario on the remote host just put it as entrypoint.
2020-03-28 11:22:55 +00:00
* **Open**. Currently supported five shells and the count could be grow by community.
2020-03-15 18:35:48 +00:00
2020-03-09 23:01:29 +00:00
## Q&A
2020-03-04 14:48:54 +00:00
2020-03-30 20:07:55 +00:00
### How it works?
2020-03-30 20:05:37 +00:00
When you run `xxh myhost` command xxh download portable shell and store locally to future use. Then if it needed xxh upload the portable shell, init scripts and plugins to the host. Finally xxh make ssh connection to the host and run portable shell without any system installs, root access and affection on the target host.
2020-03-30 20:07:55 +00:00
### How to use `/home/me` as home instead of `/home/me/.xxh`?
2020-03-30 20:05:37 +00:00
Add `+hhh '~'` argument to the command or to `config.xxhc`.
2020-03-30 20:10:09 +00:00
By default xxh uses hermetic environment where `$HOME` is `~/.xxh`. When you add `+hhh '~'` argument you set `$HOME` to your orinary user home directory. But [XDG](https://specifications.freedesktop.org/basedir-spec/basedir-spec-latest.html) still in `~/.xxh`. This is semihermetic because any tools you use during xxh session that aren't support XDG can write to your home directory.
2020-03-30 20:05:37 +00:00
2020-03-30 20:18:43 +00:00
Finally when you add `+hhx '~'` you also redirect [XDG](https://specifications.freedesktop.org/basedir-spec/basedir-spec-latest.html) to user home directory and any tools you use during ssh session and xxh session has the same data, configs and cache. This is very useful when you don't need hermetisation and you want just use xxh like ssh with saving all your configs, data and cache in your home directory.
2020-03-30 20:05:37 +00:00
2020-03-30 20:07:55 +00:00
### What about speed?
2020-03-30 20:05:37 +00:00
The first connection takes time for downloading and uploading portable shell. It depends on portable shell size and channel speed. But when xxh is installed on the host and you do just `xxh myhost` then it works as ordinary ssh connection speed plus speed of initializing the shell you used. You could monitor all process using `+vv` argument.
2020-02-08 23:32:13 +00:00
2020-03-30 20:07:55 +00:00
### What if my `host_internal` can be reached only from my `host_external`?
2020-03-30 20:05:37 +00:00
Add `ProxyCommand` or `ProxyJump` to your ssh config [as described](https://superuser.com/questions/96489/an-ssh-tunnel-via-multiple-hops#answer-170592) and then do ordinary `xxh host_internal`.
2019-11-03 14:34:38 +00:00
2020-03-30 20:09:00 +00:00
### What is xxh plugin?
2019-11-03 15:22:54 +00:00
2020-03-30 20:09:00 +00:00
It is the set of scripts which will be run on the host when you go using xxh. It could be shell settings, aliases, environment variables, frameworks, extensions, color themes and everything you need. You can find the links to plugins on [xxh-shells repos](https://github.com/search?q=xxh%2Fxxh-shell&type=Repositories). Feel free to fork it.
2020-03-21 19:11:18 +00:00
2020-03-13 13:46:41 +00:00
## Use cases
2020-03-13 14:39:26 +00:00
### Python everywhere with xonsh
2020-03-27 16:58:28 +00:00
When you run `xxh myhost +s xonsh-appimage` you'll get portable python, pip and python-powered shell on the host without any system installations on the host. Add plugins: [autojump](https://github.com/xxh/xxh-plugin-xonsh-autojump) saves time, [pipeliner](https://github.com/xxh/xxh-plugin-xonsh-pipe-liner) manipulates lines and [bar](https://github.com/xxh/xxh-plugin-xonsh-theme-bar) looks nice.
2020-03-13 13:46:41 +00:00
2020-03-14 20:56:22 +00:00
### Oh My Zsh seamless SSH ([demo](https://asciinema.org/a/rCiT9hXQ5IdwqOwg6rifyFZzb))
2020-03-14 11:59:58 +00:00
```shell script
2020-03-21 21:27:59 +00:00
source xxh.zsh myhost +I xxh-plugin-zsh-ohmyzsh +if +q
2020-03-13 13:46:41 +00:00
```
2020-03-19 06:19:13 +00:00
This command brings your current Oh My Zsh session theme to the xxh session. If you need more complex settings just fork the [xxh-plugin-zsh-ohmyzsh](https://github.com/xxh/xxh-plugin-zsh-ohmyzsh) and hack it.
2020-03-13 13:46:41 +00:00
2020-03-13 14:39:26 +00:00
### Read host as a table with osquery
2020-03-14 12:01:51 +00:00
```
2020-03-13 13:46:41 +00:00
$ xxh myhost +s osquery
osquery> SELECT * FROM users WHERE username='news';
+-----+-----+----------+-------------+-----------------+-------------------+
| uid | gid | username | description | directory | shell |
+-----+-----+----------+-------------+-----------------+-------------------+
| 9 | 9 | news | news | /var/spool/news | /usr/sbin/nologin |
+-----+-----+----------+-------------+-----------------+-------------------+
```
### All in one portable home
The xxh is very agile. You can create your own `xxh-shell` (shell word means it has entrypoint) which has any portable tools
that you could help you on the host. [Bash-zero](https://github.com/xxh/xxh-shell-bash-zero) xxh-shell is one of this platforms that could be forked and stuffed.
2020-02-12 14:08:21 +00:00
## Development
2020-03-09 22:58:00 +00:00
In the [xxh-dev](https://github.com/xxh/xxh-dev) repo there is full [docker](https://www.docker.com/)ised environment for development, testing and contribution. The process of testing and development is orchestrated by `xde` tool and as easy as possible.
2020-02-13 10:22:57 +00:00
2020-03-22 10:45:17 +00:00
Use custom source to install your version of xxh packages:
```shell script
xxh +I xxh-shell-sample+git+https://github.com/xxh/xxh-shell-sample
xxh +I xxh-shell-sample+path+/home/user/xxh/xxh-shell-sample
xxh myhost +s xxh-shell-sample
2020-03-22 11:35:26 +00:00
```
2020-03-10 10:02:49 +00:00
2020-03-10 10:08:30 +00:00
**We have teams.** If you're in team it does not oblige to do something. The main goal of teams is to create group of passionate people who could help or support in complex questions. Some people could be expert in one shell and newbie in another shell and mutual assistance is the key to xxh evolution. [Ask join.](https://github.com/xxh/xxh/issues/50)
2020-03-02 12:02:28 +00:00
2020-02-09 09:10:08 +00:00
## Thanks
2020-03-17 17:23:09 +00:00
* **niess** for great [linuxdeploy-plugin-python](https://github.com/niess/linuxdeploy-plugin-python/)
* **probonopd** and **TheAssassin** for hard-working [AppImage](https://github.com/AppImage)
* **Roman Perepelitsa** for incredible [statically-linked, hermetic, relocatable Zsh](https://github.com/romkatv/zsh-bin)
2020-03-21 08:56:33 +00:00
* **Anthony Scopatz**, **Gil Forsyth**, **Jamie Bliss**, **David Strobach**, **Morten Enemark Lund** and **@xore** for amazing [xonsh](https://github.com/xonsh/xonsh) shell