Code

The Great LDAPification#33

Code

Open

camillescottatwork wants to merge 124 commits intomainucdavis/cheeto:mainfrom ldap-refactorucdavis/cheeto:ldap-refactorCopy head branch name to clipboard

+27,036-1,758

Commits

Commits on Jul 18, 2024

• Move notebooks to their own directory

  camillescottatwork

  committed
  8e7ad31

Commits on Jul 19, 2024

• Add conda environment file

  camillescottatwork

  committed
  5b82740

• Vendor xdg-base-dirs single-file dependency (https://github.com/srstevenson/xdg-base-dirs/blob/main/src/xdg_base_dirs/__init__.py)

  camillescottatwork

  committed
  40ba268

• Add basic config file support and subcommands

  camillescottatwork

  committed
  3b81b46

Commits on Jul 24, 2024

• Update deprecated NewType marshmallow types to Annotated

  camillescottatwork

  committed
  e74f948

• Fix deprecated ruamel.safe_load usage

  camillescottatwork

  committed
  52ec54e

• Sketch out testing code, add basic 'cheeto puppet validate' tests

  camillescottatwork

  committed
  29ea542

Commits on Jul 25, 2024

• Merge branch 'main' into ldap-refactor

  camillescottatwork

  committed
  17b728c

• Remove pyyaml entirely in favor of using ruamel for both loading and dumping; ensure all dictionary keys and listlikes are sorted properly in YAML output

  camillescottatwork

  committed
  5473201

• Update dependencies: particularly, updated marshmallow and marshmallow_dataclass for typing.Annotated support

  camillescottatwork

  committed
  c438594

• Add tests for overriding values and bad shell

  camillescottatwork

  committed
  bf1197f

• TestUserRecord load

  camillescottatwork

  committed
  8c20cfb

• Remove old tests directory

  camillescott

  committed
  2520c80

Commits on Jul 29, 2024

• Test some basic user and group record loads

  camillescott

  committed
  e4fc792

• Add tests for parse_yaml and puppet_merge

  camillescott

  committed
  7390eba

• Tests for parse_yaml_forest

  camillescott

  committed
  f05a78c

Commits on Jul 30, 2024

• Basic LDAPManager with user querying, tests

  camillescott

  committed
  2101306

• gssapi dev package for gssapi package

  camillescott

  committed
  4d88253

Commits on Jul 31, 2024

• ADd ipython as dev dependency

  camillescottatwork

  committed
  34fb353

• Add user and group classes and attrs to LDAP config

  camillescottatwork

  committed
  5e85c7a

• Add testing config.yaml and UCD schemas

  camillescottatwork

  committed
  a02f58d

• Parse test config.yaml for testing config rather than creating and instance manually

  camillescottatwork

  committed
  0708d5c

Commits on Aug 3, 2024

• user querying and adding, group adding

  camillescottatwork

  committed
  3cfaa50

Commits on Aug 9, 2024

• Basic ldap-sync for puppet YAML tree

  camillescottatwork

  committed
  5aa5da7

Commits on Aug 14, 2024

• Initial schemas, functions for database

  camillescottatwork

  committed
  4b71c3f

Commits on Aug 15, 2024

• Update test config.yaml, remove unused collection field from mongo config

  camillescottatwork

  committed
  cdb4cc5

Commits on Aug 19, 2024

• Merged Mongo UserRecord type

  camillescottatwork

  committed
  71bbbf2

• site user query tweaks

  camillescott

  committed
  e28d0bb

Commits on Aug 20, 2024

• User status updates, CLI for it

  camillescottatwork

  committed
  352b438

• Add YAML string representers to make sure long strings do not get weird extra linebreaks added when dumped

  camillescottatwork

  committed
  f725fe0

• Add database index command; finish implementing full site-level user querying CLI

  camillescottatwork

  committed
  abb92e6

• Add group querying CLI

  camillescottatwork

  committed
  58aca08

• Fix querying for full records; fix param types with query params using marshmallow field deserialization

  camillescottatwork

  committed
  a589ba4

Commits on Aug 22, 2024

• Major group membership functionality

  camillescottatwork

  committed
  9dcbdb7

• Add convenience properties to puppet UserRecord

  camillescottatwork

  committed
  86a6b76

Commits on Aug 28, 2024

• Generate HiPPO openapi client

  camillescottatwork

  committed
  054fdec

• Generate UCD IAM openapi client

  camillescottatwork

  committed
  3f99e53

• Migrate to mongoengine.

  camillescottatwork

  committed
  20d03dd

• Remove openapi geneator metadata files

  camillescottatwork

  committed
  330ab03

• hippoapi event handling

  camillescottatwork

  committed
  c9c0b6d

• Full hippoapi event processing, basic ldap load

  camillescottatwork

  committed
  2d1eda2

Commits on Aug 29, 2024

• new-system subcommand for generating new system groups

  camillescottatwork

  committed
  98b64d6

Commits on Aug 30, 2024

• Implement Slurm information in database

  camillescottatwork

  committed
  b4a6a49

• Implement slurmers - ie slurm account membership without group membership

  camillescottatwork

  committed
  0fbf723

• Add guarded database purge function

  camillescottatwork

  committed
  dffa360

• Add sitename index field to slurm qos in database

  camillescottatwork

  committed
  0e4b465

• Slurm sync adapter for database source

  camillescottatwork

  committed
  cd85a1b

• implement signal handlers for global groups and slurmers

  camillescottatwork

  committed
  9e7c97b

Commits on Aug 31, 2024

• Convenience properties for parent dereferencing; user portion of puppet dump

  camillescottatwork

  committed
  b964b57

Commits on Sep 5, 2024

• Storage schemas, loading; some refactoring

  camillescottatwork

  committed
  00fbbf6

Commits on Sep 6, 2024

• Add user groups to database on load

  camillescottatwork

  committed
  6613395

Commits on Sep 10, 2024

• Full Storage implementation, puppet yaml from database

  camillescottatwork

  committed
  0296e41

Commits on Sep 13, 2024

• storage syncing, storage ldap

  camillescottatwork

  committed
  90e6738

Commits on Sep 14, 2024

• Finalize storage schemas

  camillescottatwork

  committed
  a8a25cf

• storage to-puppet

  camillescottatwork

  committed
  bd61383

Commits on Sep 15, 2024

• Represent ordereddict in yaml dump, separate user and group storages in storage dump

  camillescottatwork

  committed
  f9a7a87

Commits on Sep 16, 2024

• Add sshkey syncing; ldap force; and sympa dump

  camillescottatwork

  committed
  55d917a

• Add root-key generation command

  camillescottatwork

  committed
  2250979

• Make sure the special groups still get created during ldap sync

  camillescottatwork

  committed
  58c9bf5

• Remove defaults channel from environment yaml

  camillescottatwork

  committed
  c917aac

• Add site list, don't use rich print

  camillescottatwork

  committed
  8302d9a

• add TLS mongo config option, have cheeto print some basic info to stderr on launch and db connect

  camillescottatwork

  committed
  f79b9a9

• implement git syncing for new puppet standard

  camillescottatwork

  committed
  81a82d8

• bump version

  camillescottatwork

  committed
  9801b01

• Handle empty commit properly

  camillescottatwork

  committed
  7b78c12

• Give SiteSlurmAccount slurm attribute on SiteGroup a default

  camillescottatwork

  committed
  2f55aa8

• Allow using domain name for --site argument in cheeto slurm sync

  camillescottatwork

  committed
  65af2ce

• bump version

  camillescottatwork

  committed
  1091056

• Make defaults for PuppetSlurmTRES -1 instead of None

  camillescottatwork

  committed
  f3c52e9

Commits on Sep 17, 2024

• Add group type field; add slurm as access type; add sync cmd for old puppet

  camillescottatwork

  committed
  534fe65

• bump version

  camillescottatwork

  committed
  e66d8d7

Commits on Sep 18, 2024

• add additional account level slurm params; optimize association handling; fix bugs with slurm tres types

  camillescottatwork

  committed
  d4a998b

• bump version

  camillescottatwork

  committed
  120c176

• fix sitename bugs in event processing; fix bugs in home storage querying

  camillescottatwork

  committed
  a12cd0d

• bump version

  camillescottatwork

  committed
  362a4aa

• add class user type, fix some bugs with puppet dumping

  camillescottatwork

  committed
  273a50e

Commits on Sep 19, 2024

• Fix slurm sacctmgr account add

  camillescottatwork

  committed
  dabb69b

Commits on Sep 20, 2024

• Implement add and remove for all SiteGroup listfields; fix repeated config parsing

  camillescottatwork

  committed
  dd4e0fb

Commits on Sep 21, 2024

• Implement ldap_synced update in custom QuerySet; add user access methods and subcommand

  camillescottatwork

  committed
  8eb9900

• Add help text to database user subcommands

  camillescottatwork

  committed
  e465331

Commits on Sep 25, 2024

• Change some puppet.py dataclass types to List to preserve sorting

  camillescottatwork

  committed
  4f77321

• Fix ordering on a few more fields

  camillescottatwork

  committed
  86cc374

Commits on Sep 26, 2024

• Fix bad .only() call in query_user_exists

  camillescottatwork

  committed
  5abd939

Commits on Oct 4, 2024

• Add class group type; refactor command method names; add some more pretty prints

  camillescottatwork

  committed
  a5ffa41

• Regenerate hippoapi

  camillescottatwork

  committed
  1029c4c

Commits on Oct 8, 2024

• Start reorg for mail

  camillescottatwork

  committed
  4366051

• Upgrade dependencies

  camillescottatwork

  committed
  9660fe5

Commits on Oct 12, 2024

• Add xkcdpass and pyescrypt to poetry conf

  camillescottatwork

  committed
  efc2124

• Add config profiles

  camillescottatwork

  committed
  934636c

• Implement set-password and generate-passwords subcommands

  camillescottatwork

  committed
  426a807

• bit of formatting

  camillescottatwork

  committed
  63654e7

Commits on Oct 14, 2024

• More rearrangment

  camillescottatwork

  committed
  deecac8

Commits on Oct 24, 2024

• Storage collection commands; user show queries; command aliases; etc

  camillescottatwork

  committed
  84aad67

Commits on Oct 25, 2024

• Slurm command group; subcommands for new QOSes and associations

  camillescottatwork

  committed
  7c08582

• Add --status filtering on user show

  camillescottatwork

  committed
  40b2882

Commits on Oct 28, 2024

• Implement basic n-gram search for users

  camillescottatwork

  committed
  4ceee92

• Remove deprecated user query and group query subcommands

  camillescottatwork

  committed
  c08cf3e

Commits on Nov 1, 2024

• Bring in CmdTree and related code from Cryptic

  camillescottatwork

  committed
  a672ff8

• config command and postprocessors

  camillescottatwork

  committed
  5559827

• Move EnumAction to args

  camillescottatwork

  committed
  c8d5d36

• Convert cheeto subcommands to new CmdTree API

  camillescottatwork

  committed
  ab976d1

• Remove a bunch of the old command registration

  camillescottatwork

  committed
  0fb19a2

• Fixes to handle_site_ functions

  camillescottatwork

  committed
  21ae791

• Merge branch '_tmp' into ldap-refactor

  camillescottatwork

  committed
  7309256

• more arg changes

  camillescottatwork

  committed
  55e6366

Commits on Nov 4, 2024

• Refactor out CmdTree code and use ponderosa; convert database commands to ponderosa

  camillescottatwork

  committed
  2d5b1d0

• Move all commands to cmds submodule, remove some deprecated commands

  camillescottatwork

  committed
  59b7cd3

Commits on Nov 5, 2024

• arg cleanup, ponderosa version bump

  camillescottatwork

  committed
  b6ca841

• Remove double logging handler with defaulted /dev/null; instead do no logging by default, log to stderr with --log, and log to file --log=<file>. also allows setting --log-level

  camillescottatwork

  committed
  2011172

• Properly enforce uniqueness constraint on GlobalUser and GlobalGroup gids and uids

  camillescottatwork

  committed
  225314e

• Fix edge cases in get_next_system_id and related funcs

  camillescottatwork

  committed
  9551a85

• Improved Document pretty-printing and improved new-class command

  camillescottatwork

  committed
  148316a

Commits on Nov 20, 2024

• Email templates and impl, updated mongoengine with transaction support, fixes to some subcommands

  camillescottatwork

  committed
  8fcdde9

• decompose some subcommands, add commands for adding existing global users and groups to sites

  camillescottatwork

  committed
  e26465f

• Allow setting gid in create_user

  camillescottatwork

  committed
  22b278c

Commits on Nov 21, 2024

• force add banner.txt

  camillescottatwork

  committed
  16287f9

• bump version: 1.0

  camillescottatwork

  committed
  d80facf

• Fix missing imports; bump version to 1.0.1

  camillescottatwork

  committed
  6d98a1c

• Fix subtle bug with site_arg postprocessor

  camillescottatwork

  committed
  6cfc5c3

Commits on Dec 18, 2024

• Add site creation subcommand

  camillescottatwork

  committed
  019750b

• Have sync-new-puppet dump 'share' table as well

  camillescottatwork

  committed
  b031e7b

• bump: v1.0.2 -> v1.1.0

  camillescottatwork

  committed
  f7a93f9

Commits on Dec 23, 2024

• Export /share as 2775

  camillescottatwork

  committed
  b0145e9

• v1.1.1

  camillescottatwork

  committed
  a98d5e3