Crawler Plugins

This repository contains crawler plugins for the Kabegame image collection system.

Documentation in other languages: 中文 (README.zh.md) | 日本語 | 한국어. The English, Japanese, and Korean READMEs are Generated by AI.

Plugin List

1. anihonet-wallpaper

Name: anihonet anime wallpapers
Version: 1.1.4
Description: anihonet anime wallpaper crawler plugin
Author: Kabegame

Path: plugins/anihonet-wallpaper/
Documentation: plugins/anihonet-wallpaper/README.md

Features:

• Crawl anime wallpapers from anihonetwallpaper.com
• Desktop wallpapers / mobile wallpapers
• Daily, weekly, monthly, and annual rankings

Config variables:

• start_page / end_page: Start page, end page
• wallpaper_type: Desktop (imgpc) / Mobile (sp)
• ranking_period: Daily / Weekly / Monthly / Annual

2. anime-pictures

Name: anime-pictures anime gallery
Version: 0.1.4
Description: anime-pictures anime gallery crawler (tag search)
Author: Kabegame

Path: plugins/anime-pictures/
User doc: plugins/anime-pictures/doc_root/doc.md

Features:

• Batch download wallpapers from anime-pictures.net by tag and page range
• Filter by site tags (e.g. character, work name)
• Recommended up to 100 pages per run

Config variables:

• startPage: Start page (0-based)
• endPage: End page (inclusive)
• tag: Site search tag; leave empty to crawl current list pages

3. konachan

Name: Konachan anime wallpapers
Version: 1.0.4
Description: Konachan anime wallpaper crawler plugin
Author: Kabegame

Path: plugins/konachan/

Features:

• Crawl anime wallpapers from konachan.net
• Page range (start page to end page)
• Image quality (high / medium)
• Max 100 pages per run (to avoid overload)

Config variables:

• start_page: Start page (min 1)
• end_page: End page (max 100 pages per run)
• quality: Image quality (high / medium)

4. ziworld

Name: ziworld high-quality wallpapers
Version: 0.2.2
Description: ziworld high-quality wallpaper crawler plugin
Author: Kabegame

Path: plugins/ziworld/
User doc: plugins/ziworld/doc_root/doc.md

Features:

• Fetch wallpapers from ziworld
• Multi-select categories (e.g. PC, background, anime, mobile, Genshin, Honkai)
• Site has video wallpapers but they are not downloadable

Config variables:

• category: Category multi-select (checkbox). Options include: PC, background, anime, mobile, phone wallpapers, landscape, avatars, and more

5. pixiv

名称: Pixiv
版本: 1.0.1
描述: Pixiv 插画爬虫：排行榜、收藏、画师、关键词
作者: Kabegame

路径: plugins/pixiv/
用户文档: plugins/pixiv/doc_root/doc.md

功能:

• 从 pixiv.net 爬取插画，支持四种模式：排行榜、个人收藏、画师作品、关键词搜索
• 排行榜支持日/周/月榜、男性向/女性向、AI 日榜及 R18 等类型
• 关键词支持高级搜索语法（如 (Lucy OR 边缘行者) AND 5000users）
• 部分模式需在「高级设置 → HTTP 头」中配置 Cookie，详见用户文档

配置变量:

• source：爬取类型（排行榜 / 个人收藏 / 画师作品 / 关键词搜索）
• user_id：用户 UID（收藏、画师等模式）
• ranking_mode：排行榜类型（日榜、周榜、月榜、男性向、女性向、AI 日榜及 R18 等）
• content_mode：内容类型（全部 / 插画 / 漫画 / 动图，仅部分排行榜）
• Pixiv 排行榜：start_date / end_date（均为 date + format: YYYYMMDD），闭区间逐日抓取
• artist_id：画师 UID（画师作品模式）
• keyword / search_mode / keyword_order：关键词、搜索模式（安全/R18/全部）、排序方式
• num_artworks：最大作品数（1～1000），流式下载说明见插件用户文档 plugins/pixiv/doc_root/

6. twodwallpapers

名称: 2dwallpapers二次元壁纸
版本: 0.1.0
描述: 2dwallpapers 壁纸网站爬虫
作者: Kabegame

路径: plugins/twodwallpapers/
用户文档: plugins/twodwallpapers/doc_root/doc.md

功能:

• 从 2dwallpapers.com 爬取动漫、游戏等二次元壁纸
• 支持大目录（动漫壁纸 / 游戏壁纸 / 未分类）与子目录关键字过滤
• 支持多种排序：最新、最多查看、最多喜欢、最多收藏、最近更新、随机

配置变量:

• category：大目录（动漫壁纸 / 游戏壁纸 / 未分类）
• sub_cate_key：子目录关键字（可选，按名称过滤子分类，支持正则如 Genshin|Honkai）
• max_num：爬取总数（1～1000）
• orderby：排序方式（最新 / 最多查看 / 最多喜欢 / 最多收藏 / 最近更新 / 随机）

使用方法

As Git Submodule

This repo is used as a Git submodule of the main project:

# Init submodule (first clone)
git submodule update --init --recursive

# Update submodule to latest
git submodule update --remote crawler-plugins

# Update all submodules
git submodule update --remote

Packaging Plugins

In the plugin repo

Pack plugins to .kgpg format (ZIP):

Install dependencies (first time):

bun install

Package all plugins (must be run from within the kabegame main project for CLI):

bun run package
# or
node package-plugin.js

Custom output directory (optional):

Default output: crawler-plugins/packed/. To output elsewhere (e.g. data/plugins-directory/):

node package-plugin.js --outDir ../data/plugins-directory

Package a single plugin:

node package-plugin.js <plugin-name>
# e.g.:
node package-plugin.js anihonet-wallpaper

Package only selected plugins (faster for development):

node package-plugin.js --only single-file-import local-folder-import

Generate plugin index (index.json):

pnpm run generate-index

Package and generate index:

pnpm run release

Publishing a new version:

1. Bump version in package.json
2. Commit and push to main
3. The pre-push hook will package plugins, generate index.json, and create a tag
4. GitHub Actions will create a Release and upload assets

Git Hooks:

The repo uses a pre-push hook that packages plugins, generates the index, and creates a tag. Enable hooks:

pnpm install
# or
pnpm prepare

From the main project

From the main project root:

pnpm run package-plugin crawler-plugins/plugins/<plugin-name>

Output: crawler-plugins/packed/<plugin-name>.kgpg

---

Developer docs

Plugin development guide

• Plugin directory structure
• Packaging
• File format (manifest.json, config.json, crawl.rhai)
• Variable types and config

📖 README_PLUGIN_DEV.md

Rhai API

• Navigation and fetch (to(), back(), fetch_json())
• Page info (current_url(), current_html())
• DOM queries (query(), get_attr(), query_by_text())
• URL and image helpers (resolve_url(), is_image_url(), download_image())
• Examples and notes

📖 RHAI_API.md

---

Repo info

Remote: git@github.com:kabegame/crawler-plugins.git
Main branch: main

---

Contributing

Contributions are welcome. Please:

1. Follow the standard plugin file structure
2. Provide a complete manifest.json
3. Add a clear README.md and user doc (doc_root/doc.md)

Before developing, read the main repo’s Plugin development guide and Rhai API.

---

Generated by AI