Skip to content

stn/tap-jquants

Repository files navigation

tap-jquants

GitHub Action

tap-jquants is a Singer tap for JQuants.

Built with the Meltano Tap SDK for Singer Taps.

Installation

Install from GitHub:

pipx install git+https://github.com/stn/tap-jquants.git@main

Capabilities

  • catalog
  • state
  • discover
  • about
  • stream-maps
  • schema-flattening

Configuration

Accepted Config Options

Setting Required Default Description
mail_address True None The mail address to authenticate against the J-Quants API service
password True None The password to authenticate against the J-Quants API service
start_date False None The earliest record date to sync

A full list of supported settings and capabilities for this tap is available by running:

tap-jquants --about

Configure using environment variables

This Singer tap will automatically import any environment variables within the working directory's .env if the --config=ENV is provided, such that config values will be considered if a matching environment variable is set either in the terminal context or in the .env file.

Source Authentication and Authorization

You need mail_address and password for J-Quants API.

Usage

You can easily run tap-jquants by itself or in a pipeline using Meltano.

Executing the Tap Directly

tap-jquants --version
tap-jquants --help
tap-jquants --config CONFIG --discover > ./catalog.json

Developer Resources

Follow these instructions to contribute to this project.

Initialize your Development Environment

pipx install poetry
poetry install

Create and Run Tests

Create tests within the tests sub-folder and then run:

poetry run pytest

You can also test the tap-jquants CLI interface directly using poetry run:

poetry run tap-jquants --help

Testing with Meltano

Note: This tap will work in any Singer environment and does not require Meltano. Examples here are for convenience and to streamline end-to-end orchestration scenarios.

Next, install Meltano (if you haven't already) and any needed plugins:

# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-jquants
meltano install

Now you can test and orchestrate using Meltano:

# Test invocation:
meltano invoke tap-jquants --version
# Configure the tap-jquants:
meltano config tap-jquants set --interactive
# Select streams:
meltano select tap-jquants topix "*"
# And run a test `elt` pipeline:
meltano run tap-jquants target-jsonl

SDK Dev Guide

See the dev guide for more instructions on how to use the SDK to develop your own taps and targets.

References

About

Singer.io tap for J-Quants

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages