xxh/README.md

183 lines
12 KiB
Markdown
Raw Normal View History

2020-03-09 22:23:17 +00:00
<p align="center">You chosen a command shell and spent months to stuffed it with shortcuts and colors. But when you move from local to remote host using ssh you lose it all. The mission of xxh is to bring your favorite shell wherever you go through the ssh.</p>
2020-03-29 13:51:13 +00:00
<p align="center">No installations or root access on the host required.</p>
2020-02-08 23:03:26 +00:00
<p align="center">
2020-03-14 07:51:21 +00:00
<a href="https://pypi.org/project/xxh-xxh/" target="_blank"><img src="https://img.shields.io/pypi/v/xxh-xxh.svg" alt="[release]"></a>
2020-03-14 12:05:33 +00:00
<a href="https://gitter.im/xxh-xxh/community?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge" target="_blank"><img alt="[gitter chat]" src="https://badges.gitter.im/xxh-xxh/community.svg"></a>
2020-03-14 07:51:21 +00:00
<img alt="[BSD license]" src="https://img.shields.io/pypi/l/xxh-xxh">
2020-02-08 23:03:26 +00:00
</p>
2020-03-22 11:35:26 +00:00
<p align="center">
If you like the idea of xxh click ⭐ on the repo and spread the word.
</p>
2019-11-03 15:13:42 +00:00
2020-03-22 10:07:08 +00:00
## Installation methods
2020-03-27 19:17:21 +00:00
#### PyPi 3
2020-03-14 11:59:58 +00:00
```shell script
2020-03-24 11:34:58 +00:00
pip3 install -U xxh-xxh
2019-11-04 08:58:11 +00:00
```
2020-03-27 19:17:21 +00:00
#### Linux portable binary
```
mkdir ~/xxh && cd ~/xxh
wget https://github.com/xxh/xxh-portable/raw/master/result/xxh-portable-musl-alpine-Linux-x86_64.tar.gz
tar -xzf xxh-portable-musl-alpine-Linux-x86_64.tar.gz
./xxh
```
2020-03-22 10:07:08 +00:00
#### AppImage
```
mkdir ~/xxh && cd ~/xxh
2020-03-28 10:50:52 +00:00
wget -O xxh https://github.com/xxh/xxh-appimage/releases/download/continuous/xxh-release-x86_64.AppImage
2020-03-27 19:46:32 +00:00
chmod +x xxh && ./xxh
2020-03-22 10:07:08 +00:00
```
2020-03-27 17:03:14 +00:00
To use seamless mode run `./xxh ++extract-sourcing-files` to extract `xxh.*sh` files to the current directory then run `source xxh.zsh myhost` command for seamless connecting.
2020-03-19 06:19:13 +00:00
2020-03-22 10:45:17 +00:00
## Supported shells
2020-03-29 09:12:08 +00:00
| xxh-shell-`...` | status | seamless | plugins | demo |
|-----------------------------------------------------------------------|------------|-------------|---------|------|
2020-03-31 07:54:57 +00:00
| **[xonsh-appimage](https://github.com/xxh/xxh-shell-xonsh-appimage)** | stable | `xxh.xsh` | [pipeliner](https://github.com/xxh/xxh-plugin-xonsh-pipe-liner), [bar](https://github.com/xxh/xxh-plugin-xonsh-theme-bar), [autojump](https://github.com/xxh/xxh-plugin-xonsh-autojump), [example](https://github.com/xxh/xxh-plugin-xonsh-example) | <a href="https://asciinema.org/a/osSEzqnmH9pMYEZibNe2K7ZL7" target="_blank"><img alt="[demo xonsh]" src="https://img.shields.io/badge/demo-xonsh-grass"></a> |
2020-03-31 07:50:43 +00:00
| **[zsh](https://github.com/xxh/xxh-shell-zsh)** | stable | `xxh.zsh` | [ohmyzsh](https://github.com/xxh/xxh-plugin-zsh-ohmyzsh), [p10k](https://github.com/xxh/xxh-plugin-zsh-powerlevel10k), [example](https://github.com/xxh/xxh-plugin-zsh-example) | <a href="https://asciinema.org/a/rCiT9hXQ5IdwqOwg6rifyFZzb" target="_blank"><img alt="[demo zsh]" src="https://img.shields.io/badge/demo-zsh-grass"></a> |
| **[fish](https://github.com/xxh/xxh-shell-fish)** | prestable | | [example](https://github.com/xxh/xxh-plugin-fish-example) | |
| **[bash-zero](https://github.com/xxh/xxh-shell-bash-zero)** | prestable | `xxh.bash` | [ohmybash](https://github.com/xxh/xxh-plugin-bash-ohmybash), [example](https://github.com/xxh/xxh-plugin-bash-vim) | <a href="https://asciinema.org/a/314508" target="_blank"><img alt="[demo bash]" src="https://img.shields.io/badge/demo-bash-grass"></a> |
2020-03-29 09:12:08 +00:00
| **[osquery](https://github.com/xxh/xxh-shell-osquery)** | beta | | | |
| **[fish-appimage](https://github.com/xxh/xxh-shell-fish-appimage)** | alpha | | | |
2020-03-31 15:05:50 +00:00
2020-03-29 12:43:06 +00:00
The "zero" means the shell installed on host will be used.
2020-03-24 19:33:10 +00:00
2020-03-31 07:50:43 +00:00
[Search xxh shell on Github](https://github.com/search?q=xxh-shell&type=Repositories) or [Bitbucket](https://bitbucket.org/repo/all?name=xxh-shell) or [create your shell entrypoint](https://github.com/xxh/xxh-shell-example) to use another portable shell.
2020-03-22 10:45:17 +00:00
## Usage
Use `xxh` as replace `ssh` to connecting to the host without changing ssh arguments:
2020-03-14 12:01:51 +00:00
```
2020-03-22 10:45:17 +00:00
xxh <host from ~/.ssh/config>
xxh [ssh arguments] [user@]host[:port] [xxh arguments]
xxh [+I xxh-package ...] [+L] [+RI xxh-package ...] [+R xxh-package ...]
2019-11-03 14:34:38 +00:00
```
2020-03-22 10:45:17 +00:00
Common examples (use `xxh --help` to get info about arguments):
2020-03-28 21:01:32 +00:00
```yaml
2020-03-30 21:37:23 +00:00
xxh myhost # connect to the host
xxh -i id_rsa -p 2222 myhost # using ssh arguments: port and key
xxh myhost +s zsh # set the shell
xxh myhost +s xonsh-appimage +hhh "~" # set /home/user as home directory (read Q&A)
xxh myhost +s bash-zero +I xxh-plugin-bash-vim # preinstall the plugin
xxh myhost +if +q # install without questions in quiet mode
xxh myhost +hh /tmp/xxh +hhr # upload xxh to /tmp/xxh and remove when disconnect
source xxh.zsh myhost +I xxh-plugin-zsh-ohmyzsh # connect in seamless mode with ohmyzsh plugin
2020-03-22 10:45:17 +00:00
```
2020-03-30 21:20:04 +00:00
To reusing arguments there is `~/.config/xxh/config.xxhc` config file in [YAML](https://en.wikipedia.org/wiki/YAML) format:
2020-03-14 11:59:58 +00:00
```yaml
2020-03-11 10:47:09 +00:00
hosts:
2020-03-30 21:20:04 +00:00
".*": # for all hosts
+s: xxh-shell-fish # use fish shell
2020-03-13 13:46:41 +00:00
myhost: # settings for myhost
-p: 2222 # set special port
2020-03-22 10:45:17 +00:00
+s: xxh-shell-zsh # use zsh shell
2020-03-30 21:20:04 +00:00
+I: xxh-shell-zsh # install xxh-shell if needed
+I: xxh-plugin-zsh-ohmyzsh # install xxh-plugin if needed
2020-03-13 13:50:31 +00:00
+e: ZSH_THEME="clean" # set ohmyzsh theme
2020-03-30 21:20:04 +00:00
+hhh: "~" # set /home/user as home directory
2020-03-11 10:47:09 +00:00
2020-03-30 21:20:04 +00:00
"company-.*": # for all hosts by regex pattern
+if: # don't asking about install
+s: xonsh-appimage # use xonsh shell
+hh: /tmp/.xxh # use special xxh home directory
+hhr: # remove host xxh home after disconnect
2020-03-11 10:47:09 +00:00
```
2020-03-22 10:45:17 +00:00
The arguments will be automatically added when you run `xxh myhost` or `xxh company-server1`.
2020-03-30 21:20:04 +00:00
If you add `+I` arguments with appropriate xxh packages you can make your config file complete and simplify the usage command to `xxh myhost`.
2020-02-16 17:17:07 +00:00
2020-03-15 18:35:48 +00:00
## The ideas behind xxh
2020-03-30 21:13:13 +00:00
**Portable**. By default building occurs locally and then xxh uploads the result to host. No installations or root access on the host required. The security and careful about environment on the host are behind it.
**Careful**. No blindfold copying config files from local to remote host. The privacy and repeatability reasons are behind it. Every xxh package, shell or plugin is the bridge that use only what required, no more.
**Hermetic**. If you delete `~/.xxh` directory from the remote host then xxh has never been on the host. If files appears outside xxh home directory feel free to report about this cases.
**Fork-ready**. Every repo could be forked, customized and used without waiting of package management system, xxh releases or any third party.
**Do more**. The xxh packages are not only about shells. Any type of tool or code could be behind "shell entrypoint". If you want to play Super Mario on the remote host just put it as entrypoint.
**Be open**. Currently supported five shells and the count could be grow by community.
2020-03-15 18:35:48 +00:00
2020-03-09 23:01:29 +00:00
## Q&A
2020-03-04 14:48:54 +00:00
2020-03-30 20:07:55 +00:00
### How it works?
2020-03-30 20:05:37 +00:00
When you run `xxh myhost` command xxh download portable shell and store locally to future use. Then if it needed xxh upload the portable shell, init scripts and plugins to the host. Finally xxh make ssh connection to the host and run portable shell without any system installs, root access and affection on the target host.
2020-03-30 21:07:32 +00:00
### How to set `/home/user` as home instead of `/home/user/.xxh`?
2020-03-30 20:05:37 +00:00
Add `+hhh '~'` argument to the command or to `config.xxhc`.
2020-03-30 20:21:38 +00:00
By default xxh uses hermetic environment where `$HOME` is `/home/user/.xxh`. When you add `+hhh '~'` argument
2020-03-31 06:12:51 +00:00
you set `$HOME` to your orinary user home directory. Note that [XDG](https://specifications.freedesktop.org/basedir-spec/basedir-spec-latest.html)
directories are still in `/home/user/.xxh`. This is semihermetic because any tools you use during xxh session
2020-03-30 20:21:38 +00:00
that aren't support XDG can write to your home directory.
2020-03-30 20:05:37 +00:00
2020-03-31 06:12:51 +00:00
Finally when you don't need hermetization and you want to use xxh like ssh just add two arguments: `+hhh '~' +hhx '~'`.
By this way you set the [XDG](https://specifications.freedesktop.org/basedir-spec/basedir-spec-latest.html)
directories to user home and any tools you use during ssh and xxh will have the same data, configs and cache.
2020-03-30 20:05:37 +00:00
2020-03-30 21:37:23 +00:00
### What is seamless mode?
When you run `source xxh.**** myhost` the script get the environment variables and
bring it to the xxh session. For example if you are in Oh My Zsh with `agnoster` theme with `(git docker ubuntu)`
plugins then command `xxh +I xxh-plugin-zsh-ohmyzsh && source xxh.zsh myhost` brings you to `myhost` with appropriate theme and plugins.
2020-03-30 20:07:55 +00:00
### What about speed?
2020-03-30 20:05:37 +00:00
2020-03-31 14:31:56 +00:00
The first connection takes time for downloading, building and uploading portable shell. It depends on portable shell size and channel speed. But when xxh is installed on the host and you do just `xxh myhost` then it works as ordinary ssh connection speed plus speed of initializing the shell you used. You could monitor all process using `+vv` argument.
2020-02-08 23:32:13 +00:00
2020-03-30 20:07:55 +00:00
### What if my `host_internal` can be reached only from my `host_external`?
2020-03-30 20:05:37 +00:00
Add `ProxyCommand` or `ProxyJump` to your ssh config [as described](https://superuser.com/questions/96489/an-ssh-tunnel-via-multiple-hops#answer-170592) and then do ordinary `xxh host_internal`.
2019-11-03 14:34:38 +00:00
2020-03-30 20:09:00 +00:00
### What is xxh plugin?
2019-11-03 15:22:54 +00:00
2020-03-30 20:09:00 +00:00
It is the set of scripts which will be run on the host when you go using xxh. It could be shell settings, aliases, environment variables, frameworks, extensions, color themes and everything you need. You can find the links to plugins on [xxh-shells repos](https://github.com/search?q=xxh%2Fxxh-shell&type=Repositories). Feel free to fork it.
2020-03-21 19:11:18 +00:00
2020-03-13 13:46:41 +00:00
## Use cases
2020-03-13 14:39:26 +00:00
### Python everywhere with xonsh
2020-03-27 16:58:28 +00:00
When you run `xxh myhost +s xonsh-appimage` you'll get portable python, pip and python-powered shell on the host without any system installations on the host. Add plugins: [autojump](https://github.com/xxh/xxh-plugin-xonsh-autojump) saves time, [pipeliner](https://github.com/xxh/xxh-plugin-xonsh-pipe-liner) manipulates lines and [bar](https://github.com/xxh/xxh-plugin-xonsh-theme-bar) looks nice.
2020-03-13 13:46:41 +00:00
2020-03-14 20:56:22 +00:00
### Oh My Zsh seamless SSH ([demo](https://asciinema.org/a/rCiT9hXQ5IdwqOwg6rifyFZzb))
2020-03-14 11:59:58 +00:00
```shell script
2020-03-21 21:27:59 +00:00
source xxh.zsh myhost +I xxh-plugin-zsh-ohmyzsh +if +q
2020-03-13 13:46:41 +00:00
```
2020-03-19 06:19:13 +00:00
This command brings your current Oh My Zsh session theme to the xxh session. If you need more complex settings just fork the [xxh-plugin-zsh-ohmyzsh](https://github.com/xxh/xxh-plugin-zsh-ohmyzsh) and hack it.
2020-03-13 13:46:41 +00:00
2020-03-13 14:39:26 +00:00
### Read host as a table with osquery
2020-03-14 12:01:51 +00:00
```
2020-03-13 13:46:41 +00:00
$ xxh myhost +s osquery
osquery> SELECT * FROM users WHERE username='news';
+-----+-----+----------+-------------+-----------------+-------------------+
| uid | gid | username | description | directory | shell |
+-----+-----+----------+-------------+-----------------+-------------------+
| 9 | 9 | news | news | /var/spool/news | /usr/sbin/nologin |
+-----+-----+----------+-------------+-----------------+-------------------+
```
### All in one portable home
The xxh is very agile. You can create your own `xxh-shell` (shell word means it has entrypoint) which has any portable tools
that you could help you on the host. [Bash-zero](https://github.com/xxh/xxh-shell-bash-zero) xxh-shell is one of this platforms that could be forked and stuffed.
2020-02-12 14:08:21 +00:00
## Development
2020-03-09 22:58:00 +00:00
In the [xxh-dev](https://github.com/xxh/xxh-dev) repo there is full [docker](https://www.docker.com/)ised environment for development, testing and contribution. The process of testing and development is orchestrated by `xde` tool and as easy as possible.
2020-02-13 10:22:57 +00:00
2020-03-22 10:45:17 +00:00
Use custom source to install your version of xxh packages:
```shell script
2020-03-31 07:50:43 +00:00
xxh +I xxh-shell-example+git+https://github.com/xxh/xxh-shell-example
2020-03-31 14:31:56 +00:00
xxh +I xxh-shell-example+git+https://github.com/xxh/xxh-shell-example/tree/mybranch
2020-03-31 07:50:43 +00:00
xxh +I xxh-shell-example+path+/home/user/my-xxh-dev/xxh-shell-example
xxh myhost +s xxh-shell-example
2020-03-22 11:35:26 +00:00
```
2020-03-10 10:02:49 +00:00
2020-03-10 10:08:30 +00:00
**We have teams.** If you're in team it does not oblige to do something. The main goal of teams is to create group of passionate people who could help or support in complex questions. Some people could be expert in one shell and newbie in another shell and mutual assistance is the key to xxh evolution. [Ask join.](https://github.com/xxh/xxh/issues/50)
2020-03-02 12:02:28 +00:00
2020-02-09 09:10:08 +00:00
## Thanks
2020-03-17 17:23:09 +00:00
* **niess** for great [linuxdeploy-plugin-python](https://github.com/niess/linuxdeploy-plugin-python/)
* **probonopd** and **TheAssassin** for hard-working [AppImage](https://github.com/AppImage)
* **Roman Perepelitsa** for incredible [statically-linked, hermetic, relocatable Zsh](https://github.com/romkatv/zsh-bin)
2020-03-21 08:56:33 +00:00
* **Anthony Scopatz**, **Gil Forsyth**, **Jamie Bliss**, **David Strobach**, **Morten Enemark Lund** and **@xore** for amazing [xonsh](https://github.com/xonsh/xonsh) shell