xxh/README.md

146 lines
11 KiB
Markdown
Raw Normal View History

2020-03-09 22:23:17 +00:00
<p align="center">You chosen a command shell and spent months to stuffed it with shortcuts and colors. But when you move from local to remote host using ssh you lose it all. The mission of xxh is to bring your favorite shell wherever you go through the ssh.</p>
2020-02-08 23:03:26 +00:00
<p align="center">
2020-03-14 07:51:21 +00:00
<a href="https://pypi.org/project/xxh-xxh/" target="_blank"><img src="https://img.shields.io/pypi/v/xxh-xxh.svg" alt="[release]"></a>
2020-03-21 08:56:33 +00:00
<a href="https://asciinema.org/a/osSEzqnmH9pMYEZibNe2K7ZL7" target="_blank"><img alt="[demo xonsh]" src="https://img.shields.io/badge/demo-xonsh-grass"></a>
<a href="https://asciinema.org/a/rCiT9hXQ5IdwqOwg6rifyFZzb" target="_blank"><img alt="[demo zsh]" src="https://img.shields.io/badge/demo-zsh-grass"></a>
2020-03-14 12:05:33 +00:00
<a href="https://gitter.im/xxh-xxh/community?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge" target="_blank"><img alt="[gitter chat]" src="https://badges.gitter.im/xxh-xxh/community.svg"></a>
2020-03-14 07:51:21 +00:00
<img alt="[BSD license]" src="https://img.shields.io/pypi/l/xxh-xxh">
2020-02-08 23:03:26 +00:00
</p>
2020-03-22 11:35:26 +00:00
<p align="center">
If you like the idea of xxh click ⭐ on the repo and spread the word.
</p>
2019-11-03 15:13:42 +00:00
2020-03-22 10:07:08 +00:00
## Installation methods
2020-03-27 19:17:21 +00:00
#### PyPi 3
2020-03-14 11:59:58 +00:00
```shell script
2020-03-24 11:34:58 +00:00
pip3 install -U xxh-xxh
2019-11-04 08:58:11 +00:00
```
2020-03-27 19:17:21 +00:00
#### Linux portable binary
```
mkdir ~/xxh && cd ~/xxh
wget https://github.com/xxh/xxh-portable/raw/master/result/xxh-portable-musl-alpine-Linux-x86_64.tar.gz
tar -xzf xxh-portable-musl-alpine-Linux-x86_64.tar.gz
./xxh
```
2020-03-22 10:07:08 +00:00
#### AppImage
```
mkdir ~/xxh && cd ~/xxh
wget -O xxh https://github.com/xxh/linuxdeploy-plugin-python/releases/download/continuous/xxh-release-x86_64.AppImage
2020-03-27 19:46:32 +00:00
chmod +x xxh && ./xxh
2020-03-22 10:07:08 +00:00
```
2020-03-27 17:03:14 +00:00
To use seamless mode run `./xxh ++extract-sourcing-files` to extract `xxh.*sh` files to the current directory then run `source xxh.zsh myhost` command for seamless connecting.
2020-03-19 06:19:13 +00:00
2020-03-22 10:45:17 +00:00
## Supported shells
2020-03-25 21:11:37 +00:00
| xxh-shell-`...` | status | seamless | plugins |
2020-03-24 19:30:54 +00:00
|--------------------------------------------------------------|------------|-------------|---------|
2020-03-25 21:11:37 +00:00
| **[xonsh-appimage](https://github.com/xxh/xxh-shell-xonsh-appimage)** | stable | `xxh.xsh` | [pipeliner](https://github.com/xxh/xxh-plugin-xonsh-pipe-liner), [bar](https://github.com/xxh/xxh-plugin-xonsh-theme-bar), [autojump](https://github.com/xxh/xxh-plugin-xonsh-autojump) |
| **[zsh](https://github.com/xxh/xxh-shell-zsh)** | prestable | `xxh.zsh` | [OhMyZsh](https://github.com/xxh/xxh-plugin-zsh-ohmyzsh), [powerlevel10k](https://github.com/xxh/xxh-plugin-zsh-powerlevel10k) |
| **[fish](https://github.com/xxh/xxh-shell-fish)** | prestable | | |
| **[bash-zero](https://github.com/xxh/xxh-shell-bash-zero)** | zero | `xxh.bash` | [vim](https://github.com/xxh/xxh-plugin-bash-vim) |
2020-03-24 19:30:54 +00:00
| **[osquery](https://github.com/xxh/xxh-shell-osquery)** | beta | | |
2020-03-25 21:11:37 +00:00
| **[fish-appimage](https://github.com/xxh/xxh-shell-fish-appimage)** | alpha | | |
2020-03-22 11:43:26 +00:00
2020-03-24 19:33:10 +00:00
The "zero" status means the shell installed on host will be used.
2020-03-22 11:43:26 +00:00
[Search xxh shell on Github](https://github.com/search?q=xxh-shell&type=Repositories) or [Bitbucket](https://bitbucket.org/repo/all?name=xxh-shell) or [create your shell entrypoint](https://github.com/xxh/xxh-shell-sample) to use another portable shell.
2020-03-22 10:45:17 +00:00
## Usage
Use `xxh` as replace `ssh` to connecting to the host without changing ssh arguments:
2020-03-14 12:01:51 +00:00
```
2020-03-22 10:45:17 +00:00
xxh <host from ~/.ssh/config>
xxh [ssh arguments] [user@]host[:port] [xxh arguments]
xxh [+I xxh-package ...] [+L] [+RI xxh-package ...] [+R xxh-package ...]
2019-11-03 14:34:38 +00:00
```
2020-03-22 10:45:17 +00:00
Common examples (use `xxh --help` to get info about arguments):
```shell script
xxh myhost # connect to the host
xxh -i id_rsa -p 2222 myhost # connect using key and port
xxh myhost +s zsh # connect to the host into zsh shell
source xxh.zsh myhost +I xxh-plugin-zsh-ohmyzsh # install zsh plugin then connect into zsh with seamless mode (zsh theme name will be add from local host)
2020-03-27 16:58:28 +00:00
xxh myhost +s xonsh-appimage +I xxh-plugin-xonsh-theme-bar # install xonsh plugin before connect into xonsh shell
2020-03-22 10:45:17 +00:00
xxh myhost +s bash-zero +I xxh-plugin-bash-vim # install bash plugin before connect
xxh myhost +if +q # install without questions in quiet mode
xxh myhost +hh /tmp/xxh +hhr # upload xxh to myhost:/tmp/xxh and remove it after disconnect
```
To reusing arguments there is `~/.xxh/.xxhc` [yaml](https://en.wikipedia.org/wiki/YAML) config:
2020-03-14 11:59:58 +00:00
```yaml
2020-03-11 10:47:09 +00:00
hosts:
2020-03-13 13:46:41 +00:00
myhost: # settings for myhost
-p: 2222 # set special port
2020-03-22 10:45:17 +00:00
+s: xxh-shell-zsh # use zsh shell
+I: xxh-shell-zsh # install xxh-shell before connect
2020-03-22 09:26:10 +00:00
+I: xxh-plugin-zsh-ohmyzsh # install xxh-plugin before connect
2020-03-13 13:50:31 +00:00
+e: ZSH_THEME="clean" # set ohmyzsh theme
2020-03-11 10:47:09 +00:00
2020-03-11 10:52:36 +00:00
"company-.*": # for all hosts by regex pattern
+if: # don't asking about install (++install-force)
2020-03-27 16:58:28 +00:00
+s: xonsh-appimage # use xonsh shell
2020-03-11 10:52:36 +00:00
+hh: /tmp/.xxh # use special xxh home directory (++host-xxh-home)
2020-03-14 11:44:51 +00:00
+hhr: # remove host xxh home after disconnect (++host-xxh-home-remove)
2020-03-11 10:47:09 +00:00
```
2020-03-22 10:45:17 +00:00
The arguments will be automatically added when you run `xxh myhost` or `xxh company-server1`.
If you add `+I` arguments with appropriate xxh packages (customizations described in development section) you can make your config file complete and simplify the usage command to `xxh myhost`. All xxh packages will be installed automatically.
2020-02-16 17:17:07 +00:00
2020-03-15 18:35:48 +00:00
## The ideas behind xxh
2020-03-16 07:45:50 +00:00
* **Avoid building on remote host**. The security and careful about environment on the host are behind it. This could be the optional future feature but not now.
2020-03-19 07:42:36 +00:00
* **No blindfold copying** config files from local to remote host. The privacy and repeatability reasons are behind it. Every xxh package, shell or plugin is the bridge that use only what required, no more.
2020-03-16 07:14:26 +00:00
* **Portable means clean**. If you delete `~/.xxh` directory from the remote host then xxh has never been on the host. Some temporary files of third party tools you use could be in the home directory after usage but we stand for moving them to the xxh home directory. Feel free to report about this cases.
2020-03-15 18:35:48 +00:00
* **Be fork-ready**. Every repo could be forked, customize and used without affection on package management system, xxh releases or any third party lags.
2020-03-15 18:38:05 +00:00
* **Do more**. The xxh packages are not only about shells. Any type of tool or code could be behind "shell entrypoint". If you want to play Super Mario on the remote host just put it as entrypoint.
2020-03-15 18:35:48 +00:00
* **Be open**. Currently supported four shells and the count could be grow by community.
2020-03-09 23:01:29 +00:00
## Q&A
2020-03-04 14:48:54 +00:00
2020-03-09 23:01:29 +00:00
**What is plugin?** It is the set of scripts which will be run on the host when you go using xxh. It could be shell settings, environment variables, plugins, color themes and everything you need. You can find the links to plugins on [xxh-shells repos](https://github.com/search?q=xxh%2Fxxh-shell&type=Repositories). Feel free to fork it.
2020-02-08 23:32:13 +00:00
2020-03-19 07:42:36 +00:00
**How it works?** When you run `xxh myhost` command xxh download portable shell and store locally to future use. Then if it needed xxh upload the portable shell, init scripts and plugins to the host. Finally xxh make ssh connection to the host and run portable shell without any system installs and affection on the target host.
2019-11-03 14:34:38 +00:00
2020-03-22 10:45:17 +00:00
**What about speed?** The first connection takes time for downloading and uploading portable shell. It depends on portable shell size and channel speed. But when xxh is installed on the host and you do just `xxh myhost` then it works as ordinary ssh connection speed plus speed of initializing the shell you used. You could monitor all process using `+vv` argument.
2019-11-03 15:22:54 +00:00
2020-03-21 19:11:18 +00:00
**What if my `host_internal` can be reached only from my `host_external`?** Add `ProxyCommand` or `ProxyJump` to your ssh config [as described](https://superuser.com/questions/96489/an-ssh-tunnel-via-multiple-hops#answer-170592) and then do ordinary `xxh host_internal`.
2020-03-13 13:46:41 +00:00
## Use cases
2020-03-13 14:39:26 +00:00
### Python everywhere with xonsh
2020-03-27 16:58:28 +00:00
When you run `xxh myhost +s xonsh-appimage` you'll get portable python, pip and python-powered shell on the host without any system installations on the host. Add plugins: [autojump](https://github.com/xxh/xxh-plugin-xonsh-autojump) saves time, [pipeliner](https://github.com/xxh/xxh-plugin-xonsh-pipe-liner) manipulates lines and [bar](https://github.com/xxh/xxh-plugin-xonsh-theme-bar) looks nice.
2020-03-13 13:46:41 +00:00
2020-03-14 20:56:22 +00:00
### Oh My Zsh seamless SSH ([demo](https://asciinema.org/a/rCiT9hXQ5IdwqOwg6rifyFZzb))
2020-03-14 11:59:58 +00:00
```shell script
2020-03-21 21:27:59 +00:00
source xxh.zsh myhost +I xxh-plugin-zsh-ohmyzsh +if +q
2020-03-13 13:46:41 +00:00
```
2020-03-19 06:19:13 +00:00
This command brings your current Oh My Zsh session theme to the xxh session. If you need more complex settings just fork the [xxh-plugin-zsh-ohmyzsh](https://github.com/xxh/xxh-plugin-zsh-ohmyzsh) and hack it.
2020-03-13 13:46:41 +00:00
2020-03-13 14:39:26 +00:00
### Read host as a table with osquery
2020-03-14 12:01:51 +00:00
```
2020-03-13 13:46:41 +00:00
$ xxh myhost +s osquery
osquery> SELECT * FROM users WHERE username='news';
+-----+-----+----------+-------------+-----------------+-------------------+
| uid | gid | username | description | directory | shell |
+-----+-----+----------+-------------+-----------------+-------------------+
| 9 | 9 | news | news | /var/spool/news | /usr/sbin/nologin |
+-----+-----+----------+-------------+-----------------+-------------------+
```
### All in one portable home
The xxh is very agile. You can create your own `xxh-shell` (shell word means it has entrypoint) which has any portable tools
that you could help you on the host. [Bash-zero](https://github.com/xxh/xxh-shell-bash-zero) xxh-shell is one of this platforms that could be forked and stuffed.
2020-02-12 14:08:21 +00:00
## Development
2020-03-09 22:58:00 +00:00
In the [xxh-dev](https://github.com/xxh/xxh-dev) repo there is full [docker](https://www.docker.com/)ised environment for development, testing and contribution. The process of testing and development is orchestrated by `xde` tool and as easy as possible.
2020-02-13 10:22:57 +00:00
2020-03-22 10:45:17 +00:00
Use custom source to install your version of xxh packages:
```shell script
xxh +I xxh-shell-sample+git+https://github.com/xxh/xxh-shell-sample
xxh +I xxh-shell-sample+path+/home/user/xxh/xxh-shell-sample
xxh myhost +s xxh-shell-sample
2020-03-22 11:35:26 +00:00
```
2020-03-10 10:02:49 +00:00
2020-03-10 10:08:30 +00:00
**We have teams.** If you're in team it does not oblige to do something. The main goal of teams is to create group of passionate people who could help or support in complex questions. Some people could be expert in one shell and newbie in another shell and mutual assistance is the key to xxh evolution. [Ask join.](https://github.com/xxh/xxh/issues/50)
2020-03-02 12:02:28 +00:00
2020-02-09 09:10:08 +00:00
## Thanks
2020-03-17 17:23:09 +00:00
* **niess** for great [linuxdeploy-plugin-python](https://github.com/niess/linuxdeploy-plugin-python/)
* **probonopd** and **TheAssassin** for hard-working [AppImage](https://github.com/AppImage)
* **Roman Perepelitsa** for incredible [statically-linked, hermetic, relocatable Zsh](https://github.com/romkatv/zsh-bin)
2020-03-21 08:56:33 +00:00
* **Anthony Scopatz**, **Gil Forsyth**, **Jamie Bliss**, **David Strobach**, **Morten Enemark Lund** and **@xore** for amazing [xonsh](https://github.com/xonsh/xonsh) shell