Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[EPIC] Tasks for a new Top Level Apache Project #9691

Closed
18 of 19 tasks
alamb opened this issue Mar 19, 2024 · 29 comments · Fixed by apache/arrow-site#512
Closed
18 of 19 tasks

[EPIC] Tasks for a new Top Level Apache Project #9691

alamb opened this issue Mar 19, 2024 · 29 comments · Fixed by apache/arrow-site#512
Labels
enhancement New feature or request

Comments

@alamb
Copy link
Contributor

alamb commented Mar 19, 2024

Is your feature request related to a problem or challenge?

Update: the new project was approved by the board and we are now in the process of setting it all up

We are on track to have a new top level apache project for DataFusion #6475 (see Proposal Document for more details)

Once this is approved by the ASF board, we will have some logistical things to change. This ticket tracks the work items

Describe the solution you'd like

Rename github repositories

Note it is critical in my opinion that all existing links continue to work (as in the url https://github.com/apache/arrow-datafusion/issues/9691 will be redirected to the new repo). I believe this is the default behavior in Github when a repository is renamed but we should double check.

Update docs

Infrastructure

Process

Announcements

@alamb alamb added the enhancement New feature or request label Mar 19, 2024
@andygrove
Copy link
Member

We will also need to make some updates to the release scripts and associated documentation (link to reporter URL, mailing list name, and so on)

@phillipleblanc
Copy link
Contributor

phillipleblanc commented Apr 4, 2024

Note it is critical in my opinion that all existing links continue to work (as in the url https://github.com/apache/arrow-datafusion/issues/9691 will be redirected to the new repo). I believe this is the default behavior in Github when a repository is renamed but we should double check.

Yes, I just verified this behavior is the default. I created a repo at https://github.com/phillipleblanc/datafusion-rename-test - created an issue: https://github.com/phillipleblanc/datafusion-rename-test/issues/1 and renamed the repo to datafusion-rename-success - and now the above links redirect to the new repo name.

@alamb
Copy link
Contributor Author

alamb commented Apr 4, 2024

Thank you for double checking @phillipleblanc

@alamb
Copy link
Contributor Author

alamb commented Apr 18, 2024

Its official -- DataFusion is now its own Top Level Project!

https://projects.apache.org/project.html?datafusion

I plan to file individual tickets for the tasks listed above later this morning

@alamb
Copy link
Contributor Author

alamb commented Apr 18, 2024

My plan / hope is that we leave as much of the operations of DataFusion the same day to day as we transition to our own top level project. Once we have gotten ourselves running independently then we can discuss any potential changes

I think mailing lists are the first important thing to setup, so following https://github.com/apache/arrow/blob/main/.asf.yaml, I submitted requests via https://selfserve.apache.org for the following emails

In continuing with the current norms of the DataFusion community, I did not create a [email protected] mailing list, because according to the docs "The vast majority of communication occurs in the open on our github repository in the form of tickets, issues, discussions, and Pull Requests."

Thus I think having another potential list that people might accidentally send a request would be confusing.

@metesynnada
Copy link
Contributor

🎉🎉

@andygrove
Copy link
Member

I created #10130 to make some documentation updates to change the name from Apache Arrow DataFusion to Apache DataFusion

@viirya
Copy link
Member

viirya commented Apr 18, 2024

Regarding mailing lists, I think this may not be possible or hard to do, but just curious about if there are similar cases before. Is it possible to move previous threads related to DataFusion to new mailing lists?

@andygrove
Copy link
Member

I filed an INFRA ticket to rename the repos.

https://issues.apache.org/jira/browse/INFRA-25726

@alamb
Copy link
Contributor Author

alamb commented Apr 18, 2024

Regarding mailing lists, I think this may not be possible or hard to do, but just curious about if there are similar cases before. Is it possible to move previous threads related to DataFusion to new mailing lists?

I am not sure -- maybe we could look in the INFRA JIRA tickets or file a request

@alamb
Copy link
Contributor Author

alamb commented Apr 18, 2024

I created #10133 and #10134 for logistics

I also filed #10135 to make a blog post -- I would be interested in anyone has opinions on the venue (should we post to the arrow blog or make the first post on a new datafusion specific blog)?

@alamb
Copy link
Contributor Author

alamb commented Apr 19, 2024

I got an email aknowledging the creation of the email lists, but the domain name does not appear to be working. I filed https://issues.apache.org/jira/browse/INFRA-25727 to track

@alamb
Copy link
Contributor Author

alamb commented Apr 20, 2024

@comphead pointed out to me that the commiters list of the new repo is not updated yet. I will fix that now #10154

@alamb
Copy link
Contributor Author

alamb commented Apr 20, 2024

I also filed #10155, #10156, and #10157 to track the board reports (and build some institutional knowledge)

@alamb
Copy link
Contributor Author

alamb commented Apr 21, 2024

We are sill having DNS trouble -- filed https://issues.apache.org/jira/browse/INFRA-25731

@alamb
Copy link
Contributor Author

alamb commented Apr 22, 2024

Ok, the DNS issue has been resolved.

We have the website up (needs some links fixed) https://datafusion.apache.org/

The mailing lists are working as well. For example: https://lists.apache.org/[email protected]

@phillipleblanc
Copy link
Contributor

Update .asf.yaml to point to to the new mailing list: #10189

I'm also taking a look at #10151

@alamb
Copy link
Contributor Author

alamb commented Apr 23, 2024

https://datafusion.apache.org/ now has the website live 🚀 -- thanks @phillipleblanc

@lostmygithubaccount
Copy link

this link currently still works and doesn't redirect -- will it redirect to the new one at some point? https://arrow.apache.org/datafusion/

(I know this is very new and in flight, appreciate the work here!)

@comphead
Copy link
Contributor

We should rename slack and discord channels?

@alamb
Copy link
Contributor Author

alamb commented Apr 23, 2024

this link currently still works and doesn't redirect -- will it redirect to the new one at some point? https://arrow.apache.org/datafusion/

@lostmygithubaccount (😆 ) Yes absolutely -- here is a PR to do that apache/arrow-site#502

@alamb
Copy link
Contributor Author

alamb commented Apr 23, 2024

We should rename slack and discord channels?

Update here is that @andygrove did so

@alamb
Copy link
Contributor Author

alamb commented Apr 25, 2024

Thanks to @kou we have completed #10194 and the old doc links now redirect to datafusion.apache.org now

I tested a few links like
https://arrow.apache.org/datafusion/library-user-guide/working-with-exprs.html
https://arrow.apache.org/datafusion/user-guide/cli/index.html

@alamb
Copy link
Contributor Author

alamb commented Apr 25, 2024

Update: @tisonkun has made a DOAP file 😄 -- #10233

I have created a proposed page with governance information: #10238

@alamb
Copy link
Contributor Author

alamb commented Apr 29, 2024

I filed a few more doc tweaks #10284 and #10285

I think all that is left for this epic is to write a blog post (#10135) and we can close it down

@alamb
Copy link
Contributor Author

alamb commented Apr 29, 2024

Actually, we also owe the ASF board a report each month for the first 3 months. I'll begin coordinating the first one shortly (tracked via #10281)

@alamb
Copy link
Contributor Author

alamb commented May 1, 2024

I have created a draft blog post on the arrow site for announcing the new top level project: apache/arrow-site#512

@alamb
Copy link
Contributor Author

alamb commented May 7, 2024

DataFusion Top Level Project announcement is live: https://arrow.apache.org/blog/2024/05/07/datafusion-tlp/

@alamb
Copy link
Contributor Author

alamb commented May 7, 2024

Also, we got a suggestion to make an official ASF press releas #10403

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

7 participants