Skip to content

Commit

Permalink
cleanup ideas.md some more
Browse files Browse the repository at this point in the history
Signed-off-by: Tony Worm <tony@hofstadter.io>
  • Loading branch information
verdverm committed Feb 2, 2022
1 parent 0d9af4f commit b335fe9
Showing 1 changed file with 14 additions and 26 deletions.
40 changes: 14 additions & 26 deletions ideas.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,6 @@ Enhance & expand
- [x] file append
- [x] mkdir
- [ ] memory store / load
- [ ] prevent exit when error in handler pipelines?
- [ ] rename pipeline -> run
- [ ] merge and release
- [ ] hof/flow cmd
Expand Down Expand Up @@ -51,29 +50,17 @@ i/o centralization
- [ ] stats for tasks & pipelines, chan to central
- [ ] obfescate secrets, centralized printing (ensure that is the case in every task / run)

Exec & Serve
Exec & Serve & async

- [ ] some way to run in background, and then kill / exit later?
- [ ] write directly to file for stdio, is it a concrete string?
- [ ] something like a goroutine, similar to api.Serve/pipeline
- [ ] message passing, via chans, websockets, kafka/rabbit

---
Bugs?

Then...


More...

- something like a goroutine, similar to api.Serve/pipeline
- message passing, via chans, websockets, kafka/rabbit

# Ideas

Example Pipeline:
- Exponential retry as an api.Call wrapper with os.Sleep
- replace sleep in example with wait for server ready
- could be tricky, because we need to generate extra tasks after the last one finished, or some conditional to ignore after success
- api req timeout
- retry status codes / message
- [ ] prevent exit when error in handler pipelines?
- [ ] rare & racey structural cycle

Helpers:

Expand All @@ -87,6 +74,8 @@ List processing:
- CUE got streaming json/yaml support
- if extracted value is a list?

### Other

Go funcs:

- rename currenct to `*Globs`
Expand All @@ -98,15 +87,14 @@ CLI:
- Support expression on globs, to select out a field on each file
- move implementation?

### Memory issues
### upstream & references

https://github.com/lipence/cue/commit/6ed69100ebd62509577826657536172ab46cf257

### cue/flow
##### Memory issues

return final value: https://github.com/cue-lang/cue/pull/1390
https://github.com/lipence/cue/commit/6ed69100ebd62509577826657536172ab46cf257

##### cue/flow

### streamer
(we now have a hof-patch for this)

- other social networks / interaction systems
return final value: https://github.com/cue-lang/cue/pull/1390

0 comments on commit b335fe9

Please sign in to comment.