buku

Display all bookmarks matching "keyword" and with "privacy" tag

$ buku [keyword] --stag [privacy]

$ buku --add [https://example.com] [search engine], [privacy]

$ buku --delete [bookmark_id]

$ buku --write [bookmark_id]

$ buku --update [bookmark_id] --tag [-] [search engine]

buku [OPTIONS] [KEYWORD [KEYWORD ...]]

buku is a command-line utility to store, tag, search and organize bookmarks.

Features

* Store bookmarks with auto-fetched title, tags and description * Auto-import from Firefox, Google Chrome and Chromium * Open bookmarks and search results in browser * Shorten, expand URLs, browse cached page from Wayback Machine * Text editor integration * Lightweight, clean interface, custom colors * Powerful search options (regex, substring...) * Continuous search with on the fly mode switch * Portable, merge-able database to sync between systems * Import/export bookmarks from/to HTML, Markdown or Orgfile * Smart tag management using redirection (>>, >, <<) * Multithreaded full DB refresh, manual encryption support * Shell completion scripts, man page with handy examples

1. The database file is stored in: - $XDG_DATA_HOME/buku/bookmarks.db, if XDG_DATA_HOME is defined (first preference), or - $HOME/.local/share/buku/bookmarks.db, if HOME is defined (second preference), or - %APPDATA%\buku\bookmarks.db, if you are on Windows, or - the current directory.

2. If the URL contains characters like ';', '&' or brackets they may be interpreted specially by the shell. To avoid it, add the URL within single or double quotes ('/").

3. URLs are unique in DB. The same URL cannot be added twice.

4. Bookmarks with immutable titles are listed with '(L)' after the title.

5. Tags: - Comma (',') is the tag delimiter in DB. A tag cannot have comma(s) in it. Tags are filtered (for unique tags) and sorted. Tags are stored in lower case and can be replaced, appended or deleted. - Page keywords having a word to comma ratio > 3 are appended to description rather than tags. - Parent folder (and subfolder) names are converted to all-lowercase tags during bookmarks HTML import. - Releases prior to v2.7 support both capital and lower cases in tags. From v2.7 all tags are stored in lowercase. An undocumented option --fixtags is introduced to modify the older tags. It also fixes another issue where the same tag appears multiple times in the tagset of a record. Run buku --fixtags once. - Tags can be edited from the prompt very easily using '>>' (append), '>' (overwrite) and '<<' (remove) symbols. The LHS of the operands denotes the indices and ranges of tags to apply (as listed by --tag or key 't' at prompt) and the RHS denotes the actual DB indices and ranges of the bookmarks to apply the change to.

6. Update operation: - If --title, --tag or --comment is passed without argument, clear the corresponding field from DB. - If --url is passed (and --title is omitted), update the title from web using the URL. Description is updated (if --comment is omitted). Tags remain untouched. - If indices are passed without any other options (--url, --title, --tag, --comment and --immutable), read the URLs from DB and update titles, description and append tags from web. Bookmarks marked immutable are skipped. - Can update bookmarks matching a search, when combined with any of the search options and no arguments to update are passed.

7. Delete operation: - When a record is deleted, the last record is moved to the index. - Delete doesn't work with range and indices provided together as arguments. It's an intentional decision to avoid extra sorting, in-range checks and to keep the auto-DB compaction functionality intact. On the same lines, indices are deleted in descending order. - Can delete bookmarks matching a search, when combined with any of the search options and no arguments to delete are passed.

8. Search works in mysterious ways: - Case-insensitive. - Matches words in URL, title and tags. - --sany : match any of the keywords in URL, title or tags. Default search option. - --sall : match all the keywords in URL, title or tags. - --deep : match substrings (`match` matches `rematched`) in URL, title and tags. - --sreg : match a regular expression (ignores --deep). - --stag : search bookmarks by tags, or list all tags alphabetically with usage count (if no arguments). Delimit the list of tags in the query with `,` to search for bookmarks that match ANY of the listed tags. Delimit tags with `+` to search for bookmarks that match ALL of the listed tags. Note that `,` and `+` cannot be used together in the same search. Exclude bookmarks matching certain tags from the results by using ` - ` followed by the tags. Note that the ` - ` operator and the ` + ` delimiter must be space separated: ` - ` instead of `-` and ` + ` instead of `+`. This is to distinguish them from hyphenated tags (e.g., `some-tag-name`) and tags with '+'s (e.g., `some+tag+name`). - Search for keywords along with tag filtering is possible. Two searches are issued (one for keywords and another for tags) and the intersection of the 2 sets is returned as the resultset. - Search results are indexed incrementally. This index is different from actual database index of a bookmark record which is shown within '[]' after the title. - Results for any keyword matches are ordered by the number of keyword matches - results matching more keywords (match score) will appear earlier in the list. Results having the same number of matches will be ranked by their record DB index. If only one keyword is searched, results will be ordered by DB index, since all matching records will have the same match score.

9. Import: - Auto-import looks in the default installation path and default user profile. - URLs starting with `place:`, `file://` and `apt:` are ignored during import. - Parent folder (and subfolder) names are automatically imported as tags if --tacit is used. - Tags are merged even if bookmark URL exists when --tacit is used.

10. Encryption is optional and manual. AES256 algorithm is used. To use encryption, the database file should be unlocked (-k) before using buku and locked (-l) afterwards. Between these 2 operations, the database file lies unencrypted on the disk, and NOT in memory. Also, note that the database file is unencrypted on creation.

11. Editor support: - A single bookmark can be edited before adding. The editor can be set using the environment variable *EDITOR* or by explicitly specifying the editor. The latter takes precedence. If -a is used along with -w, the details are populated in the editor template. - In case of edit and update (a single bookmark), the existing record details are fetched from DB and populated in the editor template. The environment variable EDITOR must be set. Note that -u works independently of -w. - All lines beginning with "#" will be stripped. Then line 1 will be treated as the URL, line 2 will be the title, line 3 will be comma separated tags, and the rest of the lines will be parsed as descriptions.

12. Proxy support: please refer to the ENVIRONMENT section.

13. Alternative DB file: - The option --db (to specify an alternative database file location) is app-only. Manual usage is prone to issues arising from human error. - Note that this option is useful if you want to store the db file in cloud synced location. Another mechanism could be to have the db file synced and create a symlink to it at the default location.

-a --add URL [tag, ...]

Bookmark URL along with comma-separated tags. A tag can have multiple words.

-u --update [...]

Update fields of the bookmarks at specified indices in DB. If no arguments are specified, all titles and descriptions are refreshed from the web. Tags remain untouched. Works with update modifiers for the fields url, title, tag and comment. If only indices are passed without any edit options, titles and descriptions are fetched and updated (if not empty). Accepts hyphenated ranges and space-separated indices. Updates search results when used with search options, if no arguments.

-w --write [editor|index]

Edit a bookmark in editor before adding it. To edit and update an existing bookmark, the index should be passed. However, in this case the environment variable EDITOR must be set. The last record is opened in EDITOR if index=-1.

-d --delete [...]

Delete bookmarks. Accepts space-separated list of indices (e.g. 5 6 23 4 110 45) or a single hyphenated range (e.g. 100-200). Note that range and list don't work together. Deletes search results when combined with search options, if no arguments.

-v --version

Show program version and exit.

-h --help

Show program help and exit.

--url [...]

Specify the URL, works with --update only. Fetches and updates title if --title is not used.

--tag [+|-] [...]

Specify comma separated tags, works with --add, --update. Clears the tags, if no arguments passed. Appends or deletes tags, if list of tags is preceded by '+' or '-' respectively.

--title [...]

Manually specify the title, works with --add, --update. Omits or clears the title, if no arguments passed.

-c --comment [...]

Add notes or description of the bookmark, works with --add, --update. Clears the comment, if no arguments passed.

--immutable N

Set the title, description and tags of a bookmark immutable during autorefresh. Works with --add, --update. N=1 sets the immutable flag, N=0 removes it. If omitted, bookmarks are added with N=0.

-s --sany keyword [...]

Search bookmarks with ANY of the keyword(s) in URL, title or tags and show the results. Prompts to enter result number to open in browser. Note that the sequential result index is not the DB index. The DB index is shown within '[]' after the title.
This is the default search option for positional arguments if no other search option is specified.

-S --sall keyword [...]

Search bookmarks with ALL keywords in URL, title or tags and show the results. Behaviour same as --sany.
Special keywords:
"blank": list entries with empty title/tag
"immutable": list entries with locked title
NOTE: To search the keywords, use --sany

--deep

Search modifier to match substrings. Works with --sany, --sall.

-r --sreg expression

Scan for a regular expression match.

-t --stag [tag [,|+] ...] [- tag, ...]

Search bookmarks by tags.
Use ',' delimiter to find entries matching ANY of the tags
Use ' + ' delimiter to find entries matching ALL of the tags. (Note that the ' + ' delimiter must be space separated)
NOTE: Cannot combine ',' and '+' in the same search
Use ' - ' to exclude bookmarks that match the tags that follow. (Note that the '-' operator must be space separated).
List all tags alphabetically, if no arguments. The usage count (number of bookmarks having the tag) is shown within first brackets.

-x --exclude keyword [...]

Exclude bookmarks matching the specified keywords. Works with --sany, --sall, --sreg and --stag.

-l --lock [N]

Encrypt (lock) the DB file with N (> 0, default 8) hash passes to generate key.

-k --unlock [N]

Decrypt (unlock) the DB file with N (> 0, default 8) hash passes to generate key.

--ai

Auto-import bookmarks from Firefox, Google Chrome and Chromium browsers.

-e --export file

Export bookmarks to Firefox bookmarks formatted HTML. Works with all search options.
Markdown is used if file has extension '.md'. Markdown format: [title](url), 1 entry per line.
Orgfile is used if file has extension '.org' Orgfile format: * [[url][title]], 1 entry per line.
A buku database is generated if file has extension '.db'.

-i --import file

Import bookmarks from Firefox bookmarks formatted HTML. file is considered Firefox-exported JSON if it has '.json' extension, Markdown (compliant with --export format) if it is '.md', Orgfile if the extension is '.org' or another buku database if the extension is '.db'.

-p --print [...]

Show details (DB index, URL, title, tags and comment) of bookmark record by DB index. If no arguments, all records with actual index from DB are shown. Accepts hyphenated ranges and space-separated indices. A negative value (introduced for convenience) behaves like the tail utility, e.g., -n shows the details of the last n bookmarks.

-f --format N

Show selective monochrome output with specific fields. Works with --print. Search results honour the option when used along with --json. Useful for creating batch scripts.
N = 1, show only URL.
N = 2, show URL and tags in a single line.
N = 3, show only title.
N = 4, show URL, title and tags in a single line.
N = 5, show title and tags in a single line.
To omit DB index from printed results, use N0, e.g., 10, 20, 30, 40, 50.

-j --json

Output data formatted as JSON, works with --print output and search results.

--colors COLORS

Set output colors. Refer to the COLORS section below for details.

--nc

Disable color output in all messages. Useful on terminals which can't handle ANSI color codes or scripted environments.

-n --count N

Number of results to show per page (default 10).

--np

Do not show the prompt, run and exit.

-o --open [...]

Open bookmarks by DB indices or ranges in browser. Open a random index if argument is omitted.

--oa

Open all search results immediately in the browser. Works best with --np. When used along with --update or --delete, URLs are opened in the browser first and then modified or deleted.

--replace old new

Replace old tag with new tag if both are passed; delete old tag if new tag is not specified.

--shorten index|URL

Shorten the URL at DB index or an independent URL using the tny.im URL shortener service.

--expand index|URL

Expand the URL at DB index or an independent URL shortened using tny.im.

--cached index|URL

Browse the latest cached version of the URL at DB index or an independent URL using the Wayback Machine. Useful for viewing the content of bookmarks which are not live any more.

--suggest

Show a list of similar tags to choose from when adding a new bookmark.

--tacit

Show lesser output. Reduces the verbosity of certain operations like add, update etc.

--nostdin

Do not attempt to read data from standard input e.g. when the program is not executed from a tty.

--threads

Maximum number of parallel network connection threads to use during full DB refresh. By default 4 connections are spawned. N can range from 1 to 10.

-V

Check the latest upstream version available. This is FYI. It is possible the latest upstream released version is still not available in your package manager as the process takes a while.

-g --debug

Show debug information and additional logs.

1-N

Browse search results by indices and ranges.

O [id|range [...]]

Try to open search results or indices (when not in a search context) in a GUI browser. Toggle try to open urls in a GUI based browser (even if BROWSER is set) if no arguments. Toggling is useful when trying to open bookmarks by DB index.

a

Open all search results in browser.

s keyword [...]

Search for records with ANY keyword.

S keyword [...]

Search for records with ALL keywords.

d

Toggle deep search to match substrings ('pen' matches 'opened').

r expression

Run a regular expression search.

t [...]

Search bookmarks by a tag. List all tags alphabetically, if no arguments.

g taglist id|range [...] [>>|>|<<] [record id|range ...]

Append, set, remove specific or all tags by indices and/or ranges to bookmark indices and/or ranges (see EXAMPLES section below). Search by space-separated taglist id(s) and/or range if records are omitted.

o id|range [...]

Browse bookmarks by indices and/or ranges.

p id|range [...]

Print bookmarks by indices and/or ranges.

w [editor|id]

Edit and add or update a bookmark.

c id

Copy url at search result index to clipboard.

?

Show help on prompt keys.

q, ^D, double Enter

Exit buku.

Completion scripts

Shell completion scripts for Bash, Fish and Zsh can be found in:
https://github.com/jarun/buku/blob/master/auto-completion

BROWSER

Overrides the default browser. Refer to:
http://docs.python.org/library/webbrowser.html

EDITOR

If defined, will be used as the editor to edit bookmarks with option --write.

https_proxy

If defined, will be used to access http and https resources through the configured proxy. Supported format:
http[s]://[username:password@]proxyhost:proxyport/

GUI integration

buku can be integrated in a GUI environment with simple tweaks. Please refer to:
https://github.com/jarun/buku/wiki/System-integration

buku allows you to customize the color scheme via a five-letter string, reminiscent of BSD LSCOLORS. The five letters represent the colors of

• index

• title

• URL

• description/comment/note

• tag

respectively. The five-letter string is passed is as the argument to the --colors option, or as the value of the environment variable BUKU_COLORS.

We offer the following colors/styles:

The default colors string is oKlxm, which stands for

• bright cyan index

• bold bright green title

• bright yellow URL

• normal description

• bright blue tag

Note that

• Bright colors (implemented as \x1b[90m - \x1b[97m) may not be available in all color-capable terminal emulators;

• Some terminal emulators draw bold text in bright colors instead;

• Some terminal emulators only distinguish between bold and bright colors via a default-off switch.

Please consult the manual of your terminal emulator as well as https://en.wikipedia.org/wiki/ANSI_escape_code for details.

1. Edit and add a bookmark from editor:

buku -w


buku -w 'gedit -w'


buku -w 'macvim -f' -a https://ddg.gg search engine, privacy

The first command picks editor from the environment variable EDITOR. The second command opens gedit in blocking mode. The third command opens macvim with option -f and the URL and tags populated in template.

2. Add a bookmark with tags 'search engine' and 'privacy', comment 'Search engine with perks', fetch page title from the web:

buku -a https://ddg.gg search engine, privacy -c Search engine with perks

In the output, >: url, +: comment, #: tags.

3. Add a bookmark with tags 'search engine' & 'privacy' and immutable custom title 'DDG':

buku -a https://ddg.gg search engine, privacy --title 'DDG' --immutable 1

Note that URL must precede tags.

4. Add a bookmark without a title (works for update too):

buku -a https://ddg.gg search engine, privacy --title

5. Edit and update a bookmark from editor:

buku -w 15012014

This will open the existing bookmark's details in the editor for modifications. Environment variable EDITOR must be set.

6. Update existing bookmark at index 15012014 with new URL, tags and comments, fetch title from the web:

buku -u 15012014 --url http://ddg.gg/ --tag web search, utilities -c Private search engine

7. Fetch and update only title for bookmark at 15012014:

buku -u 15012014

8. Update only comment for bookmark at 15012014:

buku -u 15012014 -c this is a new comment

Applies to --url, --title and --tag too.

9. Export bookmarks tagged 'tag 1' or 'tag 2' to HTML, Markdown, Orgfile or a new database:

buku -e bookmarks.html --stag tag 1, tag 2


buku -e bookmarks.md --stag tag 1, tag 2


buku -e bookmarks.org --stag tag 1, tag 2


buku -e bookmarks.db --stag tag 1, tag 2

All bookmarks are exported if search is not opted.

10. Import bookmarks from HTML, Markdown or Orgfile:

buku -i bookmarks.html


buku -i bookmarks.md


buku -i bookmarks.db

11. Delete only comment for bookmark at 15012014:

buku -u 15012014 -c

Applies to --title and --tag too. URL cannot be deleted without deleting the bookmark.

12. Update or refresh full DB with page titles from the web:

buku -u


buku -u --tacit (show only failures and exceptions)

This operation can update the title or description fields of non-immutable bookmarks by parsing the fetched page. Fields are updated only if the fetched fields are non-empty. Tags remain untouched.

13. Delete bookmark at index 15012014:

buku -d 15012014

The last index is moved to the deleted index to keep the DB compact. Add --tacit to delete without confirmation.

14. Delete all bookmarks:

buku -d

15. Delete a range or list of bookmarks:

buku -d 100-200


buku -d 100 15 200

16. Search bookmarks for ANY of the keywords 'kernel' and 'debugging' in URL, title or tags:

buku kernel debugging


buku -s kernel debugging

17. Search bookmarks with ALL the keywords 'kernel' and 'debugging' in URL, title or tags:

buku -S kernel debugging

18. Search bookmarks tagged 'general kernel concepts':

buku --stag general kernel concepts

19. Search for bookmarks matching ANY of the tags 'kernel', 'debugging', 'general kernel concepts':

buku --stag kernel, debugging, general kernel concepts

20. Search for bookmarks matching ALL of the tags 'kernel', 'debugging', 'general kernel concepts':

buku --stag kernel + debugging + general kernel concepts

21. Search for bookmarks matching any of the keywords 'hello' or 'world', excluding the keywords 'real' and 'life', matching both the tags 'kernel' and 'debugging', but excluding the tags 'general kernel concepts' and 'books':

buku hello world --exclude real life --stag 'kernel + debugging - general kernel concepts, books'
List all unique tags alphabetically:

buku --stag

23. Run a search and update the results:

buku -s kernel debugging -u --tag + linux kernel

24. Run a search and delete the results:

buku -s kernel debugging -d

25. Encrypt or decrypt DB with custom number of iterations (15) to generate key:

buku -l 15


buku -k 15

The same number of iterations must be specified for one lock & unlock instance. Default is 8, if omitted.

26. Show details of bookmarks at index 15012014 and ranges 20-30, 40-50:

buku -p 20-30 15012014 40-50

27. Show details of the last 10 bookmarks:

buku -p -10

28. Show all bookmarks with real index from database:

buku -p


buku -p | more

29. Replace tag 'old tag' with 'new tag':

buku --replace 'old tag' 'new tag'

30. Delete tag 'old tag' from DB:

buku --replace 'old tag'

31. Append (or delete) tags 'tag 1', 'tag 2' to (or from) existing tags of bookmark at index 15012014:

buku -u 15012014 --tag + tag 1, tag 2


buku -u 15012014 --tag - tag 1, tag 2

32. Open URL at index 15012014 in browser:

buku -o 15012014

33. List bookmarks with no title or tags for bookkeeping:

buku -S blank

34. List bookmarks with immutable title:

buku -S immutable

35. Shorten the URL www.google.com and the URL at index 20:

buku --shorten www.google.com


buku --shorten 20

36. Append, remove tags at prompt (taglist index to the left, bookmark index to the right):

// append tags at taglist indices 4 and 6-9 to existing tags in bookmarks at indices 5 and 2-3


buku (? for help) g 4 9-6 >> 5 3-2


// set tags at taglist indices 4 and 6-9 as tags in bookmarks at indices 5 and 2-3


buku (? for help) g 4 9-6 > 5 3-2


// remove all tags from bookmarks at indices 5 and 2-3


buku (? for help) g > 5 3-2


// remove tags at taglist indices 4 and 6-9 from tags in bookmarks at indices 5 and 2-3


buku (? for help) g 4 9-6 << 5 3-2

37. List bookmarks with colored output:

$ buku --colors oKlxm -p

https://github.com/jarun/buku

https://github.com/jarun/buku/wiki

https://github.com/jarun/buku/issues

Copyright © 2015-2021 Arun Prakash Jana <engineerarun@gmail.com>.

License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law.

Arun Prakash Jana <engineerarun@gmail.com>