v0.4.0

Changelog

This release introduces the flow command and package.

• Flow allows you to write task DAGs, which are properly run based on inter-task dependencies that are automatically inferred
• library of tasks for you to use, wide and growing variety
• ability to import flows & sets of tasks for reuse

see examples/flow and flow/tasks to see what is available. Docs will be added in the near future on https://docs.hofstadter.io

Commits

6263ed1 Merge pull request #35 from hofstadter-io/feat-pipeline
6941d77 add in-mem k/v store; ideate some new tasks
3ba33f9 add links to each output in youtube.cue example
15022f2 add lost changeset for passing pipeline flags
0d9af4f add new task os.Mkdir, enable append in os.WriteFile
90a11da add new tasks os.FileLock and os.FileUnlock
ce562e9 add some notes to ideas.md
6baa8b2 add tags to pipeline for data injection; there's a bug
096cedc add youtube api example
0b3a06e bugfixes
b76184e checkpoint before removing calls to t.Value()
b335fe9 cleanup ideas.md some more
350c53f cmd/cuetils: add verbose flag
d4c03e6 cmd/pipeline: add list & docs flags
65674a4 cmd/pipeline: add logging flag to api.Serve
f15d71d cmd/pipeline: cleanup pipeline task, and build flow.Controller when needed to ensure latest value updates are available
11ddb78 cmd/pipeline: cleanup, refactor, task:api/call
577078c cmd/pipeline: enable listing and doc printing for available pipelines
87f4215 cmd/pipeline: enable verbose printing during listing
8671d62 cmd/pipeline: fix bug in os.Getenv
9c65f7e cmd/pipeline: implement tags for injecting data from the command line
321b8f3 examples/pipeline: add new streamer example with twitch oauth and imported helper task
4f0dc48 finish s/pipeline/flow/g
5a77f05 get basic twitch bot working
9ca2391 implement api.Serve task with routes that support pipelines as their definition
4b1a37a implement db.Call.stmts to share a connection while processing a list of calls
5389d21 implement more of pipeline/os tasks; add several tests
6abd2c7 implement several pipeline/os tasks; general cleanup
4efb003 improve commands and how they are processed in the irc handler
e247dc0 in flow/tasks/*: add locks around CUE evaluator until concurrency safe
f7123ce initial pass at an ETL pipeline built on cue/flow and cuetils/ops
081e585 move around cue test & example files
2c62df5 pipeline largely working; many new task types and tests
29241a4 print tags when listing available pipelines; split up files in pipeline/
f9436ad propagate flag set if nil
910d391 prototype api.Serve task
2a2894d refactor pipeline pt1; add test cases
4cca9bc refactor pipeline task code; mostly fix issue?; update tests/cue; get twitch bot example working again
6d3596b rename example/pipeline to flow
520d1ff rename pipeline cmd to flow and regenerate
1eb0122 rename pipeline dir to flow
2d008ed repro in cuetils, but not cue/cmd
961c2c3 s/pipeline/flow/g in examples dir
8952918 s/pipeline/flow/g in flow dir
8e001fd start breaking down twitch cue files
de98ab9 test cleanup; remove empty file
689d54e update CUE and hof versions

Docker images

• docker pull hofstadter/cuetils:v0.4.0-scratch
• docker pull hofstadter/cuetils:v0.4-scratch
• docker pull hofstadter/cuetils:v0-scratch
• docker pull hofstadter/cuetils:latest-scratch
• docker pull hofstadter/cuetils:v0.4.0
• docker pull hofstadter/cuetils:v0.4
• docker pull hofstadter/cuetils:v0
• docker pull hofstadter/cuetils:latest
• docker pull hofstadter/cuetils:v0.4.0-debian
• docker pull hofstadter/cuetils:v0.4-debian
• docker pull hofstadter/cuetils:v0-debian
• docker pull hofstadter/cuetils:latest-debian