Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: Backports 1.2.0 rc2 #32270

Merged
merged 32 commits into from
Jul 8, 2019
Merged

WIP: Backports 1.2.0 rc2 #32270

merged 32 commits into from
Jul 8, 2019

Conversation

KristofferC
Copy link
Member

@KristofferC KristofferC commented Jun 9, 2019

Backported PRs:

Non-merged PRs with backport label:

Keno and others added 10 commits June 9, 2019 15:27
- The default mingw32 gfortran on ubuntu prints the version as `GNU Fortran (GCC) 7.3-win32 20180312`,
  rather than `7.3.0` most other gfortrans do, so be robust to that in normalize_triplet
- When shelling out to python use the host path rather than the windows-equivalent path, since python
  is a host tool.

(cherry picked from commit 36d6d7a)
…#32041)

instead of a 3-element Union type

(cherry picked from commit 7b34f1b)
* readdlm(bytearray) shouldn't modify bytearray

* Update stdlib/DelimitedFiles/src/DelimitedFiles.jl

Co-Authored-By: Jeff Bezanson <jeff.bezanson@gmail.com>
(cherry picked from commit 7038210)
…32266)

This method was introduced in #30552, but was unrelated to the rest of
the changes, and no-one reviewed or though about the implications.

(cherry picked from commit 5d02c59)
@KristofferC KristofferC added DO NOT MERGE Do not merge this PR! release Release management and versioning. labels Jun 9, 2019
@KristofferC KristofferC added the needs pkgeval Tests for all registered packages should be run with this change label Jun 14, 2019
fredrikekre and others added 4 commits June 14, 2019 18:03
(cherry picked from commit c630477)
As mentioned in #9378.
Fix recursion issue mentioned in #25796 by using inst_datatype_inner
instead of inst_datatype, so that we shouldn't be making copies of
any non-bound objects (anything maybe-cacheable) now.
(cherry picked from commit 217507f)
@KristofferC
Copy link
Member Author

@nanosoldier runbenchmarks(ALL, vs = ":release-1.2")

@nanosoldier
Copy link
Collaborator

Your benchmark job has completed - possible performance regressions were detected. A full report can be found here. cc @ararslan

* fixes for getindex tab-completion

* test fix

(cherry picked from commit 1eca37e)
@KristofferC

This comment has been minimized.

@JeffBezanson JeffBezanson added this to the 1.2 milestone Jun 25, 2019
@musm

This comment has been minimized.

might be related to #24333 and/or #21153
(cherry picked from commit 0d9c72d)
this works around what seems to be a glibc bug
(cherry picked from commit f77743c)
@ararslan
Copy link
Member

ararslan commented Jun 30, 2019

PkgEval failures (each link is to the corresponding log):

Looks like a number of these are failures when loading undeclared dependencies.

@fredrikekre
Copy link
Member

A lot of packages (the ones I marked) are missing (test) dependencies in their Project.toml files, and they fail now cause Pkg is fixed. Of course, it might be other failures in those packages that are hidden by the fact that they are not run due to dependency issues.

mortenpi and others added 2 commits July 1, 2019 14:57
The last return statement is currently referring to a non-existent s
variable. Also fix the related doctest, even though it does not get
tested at the moment.

(cherry picked from commit 7bda2c1)
@KristofferC
Copy link
Member Author

KristofferC commented Jul 1, 2019

The EponymTuples seems real and the MWE is

var_and_value_form(ex::Symbol) = (e = esc(ex); :($(e) = $(e)))

macro eponymtuple(args::Vararg{Symbol})
    forms = map(var_and_value_form, args)
    Expr(:tuple, forms...)
end

@macroexpand @eponymtuple(a, b)

which on 1.1 gives

:((a = a, b = b))

while on 1.2 gives

:((a = (a = a), b = (b = b)))

Perhaps you can look at this @JeffBezanson

@KristofferC
Copy link
Member Author

@nanosoldier runbenchmarks(ALL, vs = ":release-1.2")

@JeffBezanson
Copy link
Member

#32464 should fix EponymTuples

@nanosoldier
Copy link
Collaborator

Your benchmark job has completed - possible performance regressions were detected. A full report can be found here. cc @ararslan

@ararslan
Copy link
Member

ararslan commented Jul 2, 2019

New PkgEval run:

On this branch, 1336 packages were skipped due to failing dependencies, compared to 1149 packages skipped with 1.1.1.

@KristofferC
Copy link
Member Author

KristofferC commented Jul 2, 2019

Things that needs looking into:

DistributedArrays: Needs a new tag


ArnoldiMethod: https://github.com/haampie/ArnoldiMethod.jl/issues/98


MIDI: #32270 (comment)


Matrixnetwork: Passes locally


StochasticPrograms

ERROR: LoadError: LoadError: UndefVarError: YieldScenario not defined
Stacktrace:
 [1] top-level scope at /root/.julia/packages/StochasticPrograms/n6e8a/test/farmer.jl:1
 [2] include at ./boot.jl:328 [inlined]
 [3] include_relative(::Module, ::String) at ./loading.jl:1094
 [4] include(::Module, ::String) at ./Base.jl:31
 [5] include(::String) at ./client.jl:431
 [6] top-level scope at /root/.julia/packages/StochasticPrograms/n6e8a/test/runtests.jl:28
 [7] include at ./boot.jl:328 [inlined]
 [8] include_relative(::Module, ::String) at ./loading.jl:1094
 [9] include(::Module, ::String) at ./Base.jl:31
 [10] include(::String) at ./client.jl:431
 [11] top-level scope at none:5
in expression starting at /root/.julia/packages/StochasticPrograms/n6e8a/test/farmer.jl:1
in expression starting at /root/.julia/packages/StochasticPrograms/n6e8a/test/runtests.jl:28

@mbauman
Copy link
Member

mbauman commented Jul 2, 2019

DistributedArrays just needs a new tag.

@KristofferC
Copy link
Member Author

On this branch, 1336 packages were skipped due to failing dependencies, compared to 1149 packages skipped with 1.1.1.

DataFrames failing is pretty bad. Again, I think we should just test dependencies anyway, even if their parent fail.

@JeffBezanson
Copy link
Member

MIDI: the + method was removed without removing the test; not our fault.

@c42f
Copy link
Member

c42f commented Jul 3, 2019

I believe the NaturallyUnitful problem is MasonProtter/NaturallyUnitful.jl#5.

@KristofferC
Copy link
Member Author

Matrixnetwork passses locally multiple times on this branch.

@KristofferC
Copy link
Member Author

KristofferC commented Jul 3, 2019

StochasticModels error can be reprod with:

using StochasticModels

farmer_model = @stochastic_model begin
           @stage 1 begin
           end
           @stage 2 begin
               @uncertain ξ::YieldScenario = begin end
           end
       end

on this branch it erros with

ERROR: UndefVarError: YieldScenario not defined

When I run @macroexpand1 on this I get

@scenario YieldScenario = begin
        end
StochasticPrograms.StochasticModel(StageParameters(), StageParameters()) do sp
    @stage 1 sp = begin
            end
    @stage 2 sp = @uncertain::YieldScenario = begin
                    end)
end

and this executes correctly. So not sure what is happening. @JeffBezanson, perhaps you could take a look.

@ecsx1
Copy link

ecsx1 commented Jul 5, 2019

Julia 1.2.0 rc1 doesn't build on my system.
But there are 2 simple commits (already merged on master) that make it work.
Any chance to apply those for 1.2.0 rc2? They fix real bugs.

#31933
#31946

@ararslan
Copy link
Member

ararslan commented Jul 5, 2019

Including those commits here seems reasonable to me, so I've added the backport 1.2 label to the PRs. I assume they should be backported to 1.0 as well?

fredrikekre and others added 5 commits July 8, 2019 11:50
points to the last non-opt argument of argv, but
in the case where there are only options optind
does not go beyond argc, except on musl libc,
where it becomes argc + 1.

(cherry picked from commit 9de07ce)
* bug fixed in read_to_buffer

* added test for #32397.

* switch back to original case

* added torture test for long encoded string randomly laced with spaced

(cherry picked from commit 4b6ab68)
caused by c6c3d72

This is a bit of a hack that just moves things around a bit to
get a structure more likely to work.

(cherry picked from commit a25e722)
@KristofferC KristofferC removed DO NOT MERGE Do not merge this PR! needs pkgeval Tests for all registered packages should be run with this change labels Jul 8, 2019
@ararslan
Copy link
Member

ararslan commented Jul 8, 2019

The macOS buildbot seems to be consistently failing, but it works on Travis, so it's probably fine. Similarly, AppVeyor is failing but the Windows buildbots are working. The GC analysis build fails because the infrastructure for that is not present on the release-1.2 branch, only on master.

@ararslan ararslan merged commit a4129ea into release-1.2 Jul 8, 2019
@ararslan ararslan deleted the backports-1.2.0-rc2 branch July 8, 2019 17:37
vchuravy pushed a commit to JuliaLang/Distributed.jl that referenced this pull request Oct 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release Release management and versioning.
Projects
None yet
Development

Successfully merging this pull request may close these issues.