Public Datafiles And Dependencies
About This Script
Whimsy tools consume and produce a variety of data files about PMCs and the ASF as a whole. This non-comprehensive page explains which tools generate what intermediate data, and where the canonical underlying data sources are (many of which are privately stored). .json files generated in /public are consumed by many other websites.
Whimsy has a number of cron jobs - typically hourly - that periodically regenerate the /public directory, but only when the underlying data source has changed. See the server setup docs for more info. You can see the code for this script , the underlying data file , the key to this data , and many of the public JSON data files.
REMINDER: These datafiles are not original sources of truth, and merely make data from other canonical systems available in a more easily digested format on a periodic basis. Data here may be outdated depending on when updates were last made. See notifications@whimsical for updates
-
dataflow.jsonList of other public JSON and other data sources and underlying code models.
Maintained by role/PMC: whimsy
-
committee-info.jsonCommittee (PMC) names and membership
Maintained by Whimsy PMC using script: /www/roster/public_committee_info.rb
Data structure: hash of hashes['committees']['accumulo']['display_name'] = 'Accumulo'
Derived from: -
committee-retired.jsonSummary details of retired committees
Maintained by Whimsy PMC using script: /www/roster/public_committee_info.rb
Data structure: hash of hashes['retired']['abdera']['display_name'|'retired'|'description']
Derived from: -
icla-info.jsonNames of people who have submitted ICLAs who have uids (committer accounts)
Maintained by Whimsy PMC using script: /www/roster/public_icla_info.rb
Data structure: hash of hash['committers']['curcuru'] = 'Shane Curcuru'
Derived from: -
icla-info_noid.jsonNames of people who have submitted ICLAs who don't (yet) have uids (committer accounts)
Maintained by Whimsy PMC using script: /www/roster/public_icla_info.rb
Data structure: hash of array['non_committers'][0] = 'NonCommitter Name'
Derived from: -
member-info.jsonASF Member id listing
Maintained by Whimsy PMC using script: /www/roster/public_member_info.rb
Data structure: hash of arrays['members'][0] = 'aadamchik' and hash['ex_members']['dion'] = 'Deceased Member (RIP)'
Derived from: -
pods-scan.jsonCurrent status of Incubator podling websites relating to required navigation links
Maintained by Whimsy PMC using script: /tools/site-scan.rb
Data structure: hash of hashes['airflow']['display_name'] = 'Airflow'
Derived from: -
public_ldap_authgroups.jsonMembership of LDAP auth groups. Membership of an LDAP auth group is used to grant commit karma for sub-project and other resources
Maintained by Whimsy PMC using script: /www/roster/public_ldap_authgroups.rb
Data structure: hash of hashes['auth']['apachecon']['roster'][11] = 'rbowen'
Derived from: -
public_ldap_groups.jsonMembership of the remaining LDAP unix groups (apsite, committers and member).
Maintained by Whimsy PMC using script: /www/roster/public_ldap_groups.rb
Data structure: hash of hashes['groups']['committers']['roster'][0] = 'tba'
Derived from: -
public_ldap_people.jsonBasic details of LDAP personal entries. Shows the public name and whether the login is currently disabled
Maintained by Whimsy PMC using script: /www/roster/public_ldap_people.rb
Data structure: hash of hashes['people']['curcuru']['name'] = 'Shane Curcuru'
Derived from: -
public_ldap_projects.jsonDetails of PMCs and Podlings. The 'owners' list holds the ids with (P)PMC karma, and the 'members' list holds the ids with (P)PMC committer karma.
Maintained by Whimsy PMC using script: /www/roster/public_ldap_projects.rb
Data structure: hash of hashes['projects']...
Derived from: -
public_ldap_services.jsonMembership of LDAP service groups. For example pmc_chairs shows the list of people with PMC chair karma
Maintained by Whimsy PMC using script: /www/roster/public_ldap_services.rb
Data structure: hash of hashes['services']['board']['roster'][1] = 'brett'
Derived from: -
public_nonldap_groups.jsonMembership of auth groups not defined in LDAP. (this file is likely to become obsolete)
Maintained by Whimsy PMC using script: /www/roster/public_nonldap_groups.rb
Data structure: hash of hashes['groups']['blur']['roster'][0] = 'dblevins'
Derived from: -
public_podling_status.jsonCurrent Incubation status of each podling
Maintained by Whimsy PMC using script: /www/roster/public_podlings.rb
Data structure: hash of hashes['podling']['abdera'] = 'graduated'
Derived from: -
public_podlings.jsonListings of podling data TODO?
Maintained by Whimsy PMC using script: /www/roster/public_podlings.rb
Data structure: hash of hashes['podling']['abdera']['name'] = 'Abdera'
Derived from: -
site-scan.jsonCurrent status of project websites relating to required navigation links
Maintained by Whimsy PMC using script: /tools/site-scan.rb
Data structure: hash of hashes['accumulo']['display_name'] = 'Accumulo'
Derived from: -
pmcsPolicy for display of Apache PMC websites
Maintained by role/PMC: vp-brand
-
/lib/whimsy/asf/auth.rbASF::Authorization: Models LDAP and other authorizations based on id.apache.org; See also ASF::Person
Maintained by role/PMC: vp-whimsy
Derived from: -
/lib/whimsy/asf/committee.rbASF::Committee: model both PMCs and other committees; See also ASF::Person
Maintained by role/PMC: vp-whimsy
Derived from: -
/lib/whimsy/asf/icla.rbASF::ICLA: Tracks ICLAs and names; See also ASF::Person
Maintained by role/PMC: vp-whimsy
Derived from: -
/lib/whimsy/asf/ldap.rbASF::LDAP: See also ASF::Config, Person, Member, Group
Maintained by role/PMC: vp-whimsy
Derived from: -
/lib/whimsy/asf/mail.rbASF::Mail: Associate email addresses with Persons; See also ASF::Config, Person, Committee, Podling
Maintained by role/PMC: vp-whimsy
Derived from: -
/lib/whimsy/asf/member.rbASF::Member: Data and auth about ASF Members; See also ASF::Person
Maintained by role/PMC: vp-whimsy
Derived from: -
/lib/whimsy/asf/nominees.rbExtends ASF::Person to add data about nominees around meetings
Maintained by role/PMC: vp-whimsy
Derived from: -
/lib/whimsy/asf/person.rbASF::Person: Data about an ICLA signer, committer, etc.; Extensive integration with ASF::LDAP for auth
Maintained by role/PMC: vp-whimsy
Derived from: -
/lib/whimsy/asf/podlings.rbASF::Podlings: Committee analogue for Incubator podlings
Maintained by role/PMC: vp-whimsy
Derived from: -
/lib/whimsy/asf/rack.rbASF::Rack: add functionality to ASF::Auth, ASF::Committers, ASF::MembersAndOfficers
Maintained by role/PMC: vp-whimsy
-
/lib/whimsy/asf/svn.rbASF::SVN: Utility for SVN repo and file access; See also ASF::Config(reads .whimsy)
Maintained by role/PMC: vp-whimsy
-
/lib/whimsy/asf/git.rbASF::Git: Utility for Git repo and file access; See also ASF::Config(reads .whimsy)
Maintained by role/PMC: vp-whimsy
-
/lib/whimsy/asf/agenda.rbASF::Board::Agenda: Utility for approved and posted board minutes; many touchpoints: roster tool, board minutes
Maintained by role/PMC: vp-whimsy
Derived from: -
private/committers/board/committee-info.txtOfficial record of PMC and committee membership
Maintained by role/PMC: secretary
-
infrastructure-puppet/modules/subversion_server/files/authorization/Authorization records for source control repos
Maintained by role/PMC: infra-staff
-
private/foundation/officers/iclas.txtOfficial record of signed ICLAs
Maintained by role/PMC: secretary
-
*reserved-ids.ymlID names reserved from use by committers
Maintained by role/PMC: infra-staff
-
*historic/committers.jsonHistorical data about past committer date changes
Maintained by role/PMC: vp-whimsy
-
apache/infrastructure-puppet/deployment/data/common.yamlCore infrastructure data locations
Maintained by role/PMC: infra-staff
-
private/foundation/members.txtOfficial record of ASF corporate Membership
Maintained by role/PMC: secretary
-
special/nominated-members.txtTemporary listing of Member nominees before a Member's Meeting
Maintained by role/PMC: secretary
-
asf/incubator/public/trunk/content/podlings.xmlListing of active podlings and incubation status details
Maintained by role/PMC: vp-incubator
-
asf/infrastructure/site/trunk/content/index.htmlListing of active podling websites
Maintained by role/PMC: vp-incubator
-
boardOfficial records and calendar of ASF Board of Directors
Maintained by role/PMC: secretary
The /x1/srv/whimsy/www/test/dataflow.json file is currently a manually maintained file where the hash key identifies a file:
- Starting with 'http' means it's at a public URL
- Starting with '/' means it's a path within whimsy repo
- All other paths means it's an SVN/Git reference from repository.yml
- Maintainers starting with '/' are a path to a script
- All other maintainers are a role or PMC
