v0.18.13

Dagger v0.18.13

Diff since v0.18.12

Merged pull requests:

• Add render/show_logs to chrome_trace (#540) (@m-fila)
• Include datadeps in API documentation (#541) (@m-fila)
• CompatHelper: add new compat entry for JSON3 in [weakdeps] at version 1, (keep existing compat) (#542) (@github-actions[bot])
• Add a Features/Roadmap document (#544) (@jpsamaroo)
• Add rand! implementation (#546) (@pszufe)
• add documentation for Task / Thread occupancy (#549) (@wolthom)
• Warn in docs about sync on inner loops (#550) (@quildtide)
• docs: Create favicon and add it to the documentation (#551) (@wolthom)
• @Spawn: Properly rethrow in @sync (#553) (@jpsamaroo)
• More Thunk to DTask renames (#554) (@jpsamaroo)
• Add fetch_all recursive helper (#555) (@jpsamaroo)
• @spawn: Support NamedTuple construction and access (#556) (@jpsamaroo)
• Add task/scheduler cancellation API (#557) (@jpsamaroo)
• Replace all uses of @async with Threads.@Spawn (#559) (@JamesWrigley)
• Task names, and various GraphVizExt and PlotsExt improvements (#560) (@jpsamaroo)
• Update README.md (#562) (@Rabab53)
• LU implementation for DArray (#565) (@jpsamaroo)
• Make Dagger.cancel!() handle a shutting down/shutdown scheduler (#566) (@JamesWrigley)
• use user given task names in chrome trace (#570) (@m-fila)
• Add Python integration (#572) (@jpsamaroo)

Closed issues:

• Assignable task names for logging purposes (#545)
• Parallelization across threads does not appear to work correctly (#548)

v0.18.12

Dagger v0.18.12

Diff since v0.18.11

Merged pull requests:

• DArray: Fix DMatrix show elements (#530) (@jpsamaroo)
• Dead worker handling (#532) (@JamesWrigley)
• parser: Assorted improvements (#533) (@jpsamaroo)
• aliasing: Add optimized will_alias for views (#534) (@jpsamaroo)
• DArray: Make allocations configurable via Processor (#535) (@jpsamaroo)
• Sch: Halt on Julia exit (#537) (@jpsamaroo)
• Fix typos in documentation, tests and benchmarks (#538) (@m-fila)
• Minor fixes to Datadeps for GPUs (#539) (@jpsamaroo)

Closed issues:

• Dagger's syntax when calling functions with kwards does not match Julia syntax (#421)
• BUG @spawn macro does not support do syntax (#479)
• @spawn does not work with nested function call (#480)
• Adding processes and using eager API produces warnings about workers dying (#536)

v0.18.11

Dagger v0.18.11

Diff since v0.18.10

Merged pull requests:

• Add support for limiting the evaluations of a streaming DAG (#519) (@JamesWrigley)
• CompatHelper: add new compat entry for GraphViz in [weakdeps] at version 0.2, (keep existing compat) (#520) (@github-actions[bot])
• CompatHelper: add new compat entry for DataFrames in [weakdeps] at version 1, (keep existing compat) (#521) (@github-actions[bot])
• CompatHelper: add new compat entry for Colors in [weakdeps] at version 0.12, (keep existing compat) (#522) (@github-actions[bot])
• CompatHelper: add new compat entry for Plots in [weakdeps] at version 1, (keep existing compat) (#523) (@github-actions[bot])
• DArray: Fix broken indexing caching (#525) (@jpsamaroo)
• tests: Fix assumption that rand won't return 0 (#526) (@jpsamaroo)
• delayed: Make depwarn less noisy (#527) (@jpsamaroo)
• DArray: Improve 0-dim support (#528) (@jpsamaroo)

v0.18.10

Dagger v0.18.10

Diff since v0.18.9

Merged pull requests:

• Cleanup imports with ExplicitImports.jl (#504) (@JamesWrigley)
• DArray: Add automatic partitioning and show array elements (#505) (@jpsamaroo)
• build(deps): bump julia-actions/cache from 1 to 2 (#508) (@dependabot[bot])
• Add a section to the documentation about code loading (#510) (@JamesWrigley)
• Add type restrictions to Base.isless() methods to fix invalidations (#511) (@JamesWrigley)
• logging/viz: Some fixes, and more docstrings (#513) (@jpsamaroo)
• Add option to the tests for setting the number of workers (#515) (@JamesWrigley)
• Test fixes (#516) (@JamesWrigley)
• Rename EagerThunk to DTask (#518) (@jpsamaroo)
• Datadeps: Add aliasing awareness and GPU support (#524) (@jpsamaroo)

Closed issues:

• function show_plan not working (#433)
• Cannot precompile Dagger on Julia 1.11.0-beta1 (#503)
• KeyError: key Dagger not found (#509)

v0.18.9

Dagger v0.18.9

Diff since v0.18.8

Merged pull requests:

• logging: Make IDs consistent, add helpers for logging and visualization (#468) (@jpsamaroo)
• @shard: Construct shards in parallel (#481) (@jpsamaroo)
• Reference Dagger.EAGER_THUNK_STREAMS explicitly (#484) (@JamesWrigley)
• DArray: Fixes and improvements for mapreduce operations (#485) (@jpsamaroo)
• Special-case StreamingFunction in EagerThunkMetadata() constructor (#486) (@JamesWrigley)
• Stop tracking the manifest files (#487) (@JamesWrigley)
• Fix import of ScopedValues in Julia v1.11 (#489) (@JamesWrigley)
• DArray: Implement efficient in-place matrix-matrix multiply (#492) (@Rabab53)
• Add options docstrings to the docs (#493) (@JamesWrigley)
• Doc/add Quickstart datadeps documentation (#495) (@johnmaxrin)
• Streaming branch fixes (#496) (@JamesWrigley)
• Remove more invalidations (#498) (@jpsamaroo)
• build(deps): bump julia-actions/setup-julia from 1 to 2 (#499) (@dependabot[bot])
• Add num_processors helper (#500) (@jpsamaroo)
• precompile: Don't let throwto hang the root task (#502) (@jpsamaroo)

Closed issues:

• shard executes f in sequence, not in parallel (#473)
• API Request: number of processors (including threads) (#474)
• Feature Request: Support init argument for reduce functions. (#475)
• Updating to Documenter.jl v1 (#482)
• Cannot use Dagger with Julia 1.11 (alpha2) (#488)
• Cannot use Dagger on Julia beta 1.11.0 (#501)

v0.18.8

Dagger v0.18.8

Diff since v0.18.7

• Disabled CHUNK_CACHE eviction logic
• Added view and cholesky/cholesky! operations to the DArray
• Added helpers all_processors and compatible_processors
• Fixed some precompile hangs seen on Mac M-series chips
• Removed the DArray stage cache

Merged pull requests:

• Sch: Disable CHUNK_CACHE evictions for now (#467) (@jpsamaroo)
• DArray: Add Cholesky and view implementations (#469) (@jpsamaroo)
• Add some processor utilities (#470) (@jpsamaroo)
• precompile: Slightly lengthen pre-wait timeout (#471) (@jpsamaroo)
• DArray: Remove the stage cache (#472) (@jpsamaroo)

v0.18.7

Dagger v0.18.7

Diff since v0.18.6

• Added spawn_datadeps for OpenMP-style (in/out) task dependencies
• Eagerly free task results when task will no longer be used
• Assorted bug fixes

Merged pull requests:

• Add spawn_datadeps for OMP-like task model (#454) (@jpsamaroo)
• Retry jl_set_task_tid on failure (#462) (@jpsamaroo)
• Eagerly free Thunk cached results when unneeded (#464) (@jpsamaroo)
• Sch: Temporarily disable chunk cache (#465) (@jpsamaroo)

Closed issues:

• Error: "jl_set_task_tid == 0" when calling length(::DTable) (#459)

v0.18.6

Dagger v0.18.6

Diff since v0.18.5

Various bugfixes:

• Removed some 1- and 2-letter exports that could conflict with user variables
• Skipped accidental hashing of arbitrary task arguments in the scheduler
• Fixed with_options not merging new options with previously-set options (yikes!)

Merged pull requests:

• DaggerWebDash: Use gethostname and getipaddr (#451) (@jpsamaroo)
• Don't export Bytes constants (#458) (@jpsamaroo)
• reschedule_inputs: Don't hash non-Thunk inputs (#460) (@jpsamaroo)
• tests: Test for previous option preservation (#461) (@jpsamaroo)

v0.18.5

Dagger v0.18.5

Diff since v0.18.4

Fixed a variety of concurrency bugs

Merged pull requests:

• Add precompilation via PrecompileTools (#446) (@jpsamaroo)
• CompatHelper: add new compat entry for Statistics at version 1, (keep existing compat) (#447) (@github-actions[bot])
• processor_runner: Fix race in collect proc_states (#452) (@jpsamaroo)
• errormonitor_tracked: Use spin lock (#455) (@jpsamaroo)
• OSProc: Add locking around OSPROC_PROCESSOR_CACHE (#456) (@jpsamaroo)

Closed issues:

• Failed to cleanup datastore after 0 seconds Forcibly evicting all entries (#445)
• UNHANDLED TASK ERROR: ArgumentError: destination has fewer elements than required (#449)
• DTables.groupby causes issues when multiple processes available (#450)
• Occasional UndefRefError: access to undefined reference when fetching DTables (#453)

v0.18.4

Dagger v0.18.4

Diff since v0.18.3

Merged pull requests:

• options: Use with over deprecated scoped (#442) (@jpsamaroo)
• Sch: Fix various locking and WeakChunk issues (#443) (@jpsamaroo)

Closed issues:

• "Multiple concurrent writes to Dict detected!" with DTables.reduce (#437)
• scoped deprecated (#441)