Skip to content

Commit

Permalink
Move 1/24 notes to separate file
Browse files Browse the repository at this point in the history
  • Loading branch information
rscohn2 committed Mar 26, 2024
1 parent b82ea78 commit f71c996
Show file tree
Hide file tree
Showing 2 changed files with 123 additions and 106 deletions.
122 changes: 122 additions & 0 deletions meetings/2024-01-24.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,122 @@
1/24/2024
=========

Attendees:
----------

* Andrew Wafaa, Arm (Open Source Working Group chair)
* Abhishek Jain, Fujitsu
* Alex Pim, Imagination Technologies
* Alexey Kukanov, Intel
* Ankit Manerikar, Intel
* Denis Samoilov, Intel
* Igor Safanov, Intel
* Steve Capper, Arm
* Maria Kraynyuk, Intel
* Masahiro Doteguchi, Fujitsu
* Nikolay Petrov, Intel
* Pavel Kumbrasev, Intel
* Penporn Koanakatool, Google
* Ragesh Hajela, Fujitsu
* Robert Cohn, Intel
* Sarah Knepper, Intel
* Timmie Smith, Intel
* Vadim Pirogov, Intel

Agenda:
-------

* Present priorities for the Open Source Working Group
* Discuss issues and areas for work

Notes
-----

The first meeting of the UXL Foundation Open Source Working Group was
led by Andrew Wafaa from Arm.

The group went through a set of priorities that have been provided by
the UXL Steering Committee.

* Build Infrastructure
* The intention of this is to bring independent builds of the
projects and infrastructure in place that facilitates community
contributions to the projects.

* Open Source Best Practice
* The intention of this is to ensure that the projects follow the
best practices of open source development so that there is a clear
and frictionless way for the community to contribute to the
projects.

* Open Source Kernels
* The intention of this is to bring more open source code to the
projects where there are opportunities to add new kernel code
particularly to help target more vendors and architectures.

* Architecture
* Identify opportunities to simplify projects or make it easier to
support more vendor and architecture targets and also to simplify
the integration of the projects with other frameworks and
software, for example TensorFlow or PyTorch.

* Compatibility Testing
* In order to ensure that a developer using the projects has a
consistent and good experience, compatibility tests could be made
available so that they can be run on different vendors and
architectures.


* Build Infrastructure Discussion
* Due to the history of the projects the infrastructure is mostly
hosted by Intel but we would like to integrate CI, build and
testing for different vendor and architecture targets. Penporn
from Google shared information about how this is done with the
TensorFlow project:
* `Official Builds (maintained by Google)`_
* `Community Builds (maintained by 3rd parties)`_

A similar model could be adopted for UXL Foundation projects. Options
for using public cloud infrastructure for the projects include:

* The foundation funding infrastructure (this is unlikely due to the
costs involved)
* Obtaining donations of credits from public cloud infrastructure
providers (note that donations cannot be used in lieu of membership cost)
* Organisations providing infrastructure in a similar way to how Intel
currently does this

Some points to note from the discussions:

* TensorFlow has a dedicated team looking after build and CI
* The build machines needed is dictated by the volume of Pull Requests
made so can increase as contributions increase otherwise the process
can get backed up
* Some organisations require security scanning when builds are done,
some of these would be difficult to do in public
* A big improvement for projects would be to move infrastructure or
build logs in public so that the community can see this, but some
infrastructure can still live inside the corporate network
* Here is a link to an example of the infrastructure TensorFlow uses
`with Arm`_
* The best solution is to find maintainers for specific target devices
and enable them to do this through the GitHub projects

Penporn passed on the details of some Intel people working on CI for
TensorFlow who may have some advice or help.

Ragesh from Fujitsu is engaging with the oneDAL team to add an Arm
target. They have discussed modifications and changes needed to make
the external contributions work and it will be good to share this with
other projects.

Discussions will continue on the Slack channel and at the next Working
Group meeting.

**The group agreed that the Working Group will initially focus on
specific projects, with oneDAL and oneDNN the focus for the next
meeting.**

.. _`Official Builds (maintained by Google)`: https://github.com/tensorflow/tensorflow?tab=readme-ov-file#official-builds
.. _`Community Builds (maintained by 3rd parties)`: https://github.com/tensorflow/build#community-supported-tensorflow-builds
.. _ `with Arm`: https://github.com/tensorflow/tensorflow/actions/workflows/arm-ci.yml
107 changes: 1 addition & 106 deletions meetings/notes.rst
Original file line number Diff line number Diff line change
Expand Up @@ -3,110 +3,5 @@
===============

`2024-02-27 <2024-02-27.rst>`__

1/24/2024
=========

Attendees:
----------

* Andrew Wafaa, Arm (Open Source Working Group chair)
* Abhishek Jain, Fujitsu
* Alex Pim, Imagination Technologies
* Alexey Kukanov, Intel
* Ankit Manerikar, Intel
* Denis Samoilov, Intel
* Igor Safanov, Intel
* Steve Capper, Arm
* Maria Kraynyuk, Intel
* Masahiro Doteguchi, Fujitsu
* Nikolay Petrov, Intel
* Pavel Kumbrasev, Intel
* Penporn Koanakatool, Google
* Ragesh Hajela, Fujitsu
* Robert Cohn, Intel
* Sarah Knepper, Intel
* Timmie Smith, Intel
* Vadim Pirogov, Intel

Agenda:
-------

* Present priorities for the Open Source Working Group
* Discuss issues and areas for work

Notes
-----

The first meeting of the UXL Foundation Open Source Working Group was led by Andrew Wafaa from Arm.

The group went through a set of priorities that have been provided by the UXL Steering Committee.

* Build Infrastructure
* The intention of this is to bring independent builds of the projects and infrastructure in place that facilitates community contributions to the projects.

* Open Source Best Practice
* The intention of this is to ensure that the projects follow the best practices of open source development so that there is a clear and frictionless way for the community to contribute to the projects.

* Open Source Kernels
* The intention of this is to bring more open source code to the projects where there are opportunities to add new kernel code particularly to help target more vendors and architectures.

* Architecture
* Identify opportunities to simplify projects or make it easier to support more vendor and architecture targets and also to simplify the integration of the projects with other frameworks and software, for example TensorFlow or PyTorch.

* Compatibility Testing
* In order to ensure that a developer using the projects has a consistent and good experience, compatibility tests could be made available so that they can be run on different vendors and architectures.


* Build Infrastructure Discussion
Due to the history of the projects the infrastructure is mostly hosted by Intel but we would like to integrate CI, build and testing for different vendor and architecture targets.
Penporn from Google shared information about how this is done with the TensorFlow project:

* `Official Builds (maintained by Google)`_
* `Community Builds (maintained by 3rd parties)`_

A similar model could be adopted for UXL Foundation projects.
Options for using public cloud infrastructure for the projects include:

* The foundation funding infrastructure (this is unlikely due to the
costs involved)
* Obtaining donations of credits from public cloud infrastructure
providers (note that donations cannot be used in lieu of membership cost)
* Organisations providing infrastructure in a similar way to how Intel
currently does this

Some points to note from the discussions:

* TensorFlow has a dedicated team looking after build and CI
* The build machines needed is dictated by the volume of Pull Requests
made so can increase as contributions increase otherwise the process
can get backed up
* Some organisations require security scanning when builds are done,
some of these would be difficult to do in public
* A big improvement for projects would be to move infrastructure or
build logs in public so that the community can see this, but some
infrastructure can still live inside the corporate network
* Here is a link to an example of the infrastructure TensorFlow uses
`with Arm`_
* The best solution is to find maintainers for specific target devices
and enable them to do this through the GitHub projects

Penporn passed on the details of some Intel people working on CI for
TensorFlow who may have some advice or help.

Ragesh from Fujitsu is engaging with the oneDAL team to add an Arm
target. They have discussed modifications and changes needed to make
the external contributions work and it will be good to share this
with other projects.

Discussions will continue on the Slack channel and at the next
Working Group meeting.

**The group agreed that the Working Group will initially focus on
specific projects, with oneDAL and oneDNN the focus for the next
meeting.**

.. _`Official Builds (maintained by Google)`: https://github.com/tensorflow/tensorflow?tab=readme-ov-file#official-builds
.. _`Community Builds (maintained by 3rd parties)`: https://github.com/tensorflow/build#community-supported-tensorflow-builds
.. _ `with Arm`: https://github.com/tensorflow/tensorflow/actions/workflows/arm-ci.yml
`2024-01-24 <2024-01-24.rst>`__

0 comments on commit f71c996

Please sign in to comment.