{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":465915223,"defaultBranch":"main","name":"prompt_processing","ownerLogin":"lsst-dm","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2022-03-03T23:17:55.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/10968870?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1726620338.0","currentOid":""},"activityList":{"items":[{"before":"d73f6591fd7fa5060cfc0137d7dab4483ef865a1","after":"0c53e24402ab26e28e96ea399f902f4c2813aba8","ref":"refs/heads/tickets/DM-43082","pushedAt":"2024-09-23T16:20:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dspeck1","name":null,"path":"/dspeck1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16627351?s=80&v=4"},"commit":{"message":"Test message unpacking.","shortMessageHtmlLink":"Test message unpacking."}},{"before":"0e282609c517e58cee5ad44fbbfc1a584f45ce0c","after":"d73f6591fd7fa5060cfc0137d7dab4483ef865a1","ref":"refs/heads/tickets/DM-43082","pushedAt":"2024-09-23T14:04:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dspeck1","name":null,"path":"/dspeck1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16627351?s=80&v=4"},"commit":{"message":"Attempt to unpack fanned out message.","shortMessageHtmlLink":"Attempt to unpack fanned out message."}},{"before":"4075967a4d5f62c4027c69419677cf017a24c9c2","after":"f5111374c7119fb1e3138ca55d7c67749089b4f9","ref":"refs/heads/tickets/DM-43712","pushedAt":"2024-09-20T23:31:43.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"hsinfang","name":"hsinfang","path":"/hsinfang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13244058?s=80&v=4"},"commit":{"message":"Use the new Butler query system in _filter_datasets\n\nThe new Butler query systems supports spatial-constraint query\nvia lsst.sphgeom.Region directly. It is useful in template search.\n\nIn the new query system, query_datasets takes one datasetType at a\ntime, while butler.registry.queryDatasets can take a list of dataset\ntypes in the old system. So, now we query (via _filter_datasets)\none type of calibs/refcats at a timer.\n\nCurrently we attempt to preload more types of calibs/refcats than\nthe actual pipelines really need. It's possible that some types\naren't preloaded but it's okay. _MissingDatasetError is expected\nin that case.\n\nTODO:\nremove the unneeded goodSeeingCoadd in the test/data/central_repo ?\n\nNote: The old query system is still used in other places.","shortMessageHtmlLink":"Use the new Butler query system in _filter_datasets"}},{"before":"0b64d8ec271bde518858d4a78dcd360643e6f4cb","after":"4075967a4d5f62c4027c69419677cf017a24c9c2","ref":"refs/heads/tickets/DM-43712","pushedAt":"2024-09-20T22:23:15.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"hsinfang","name":"hsinfang","path":"/hsinfang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13244058?s=80&v=4"},"commit":{"message":"Use the new Butler query system in _filter_datasets\n\nThe new Butler query systems supports spatial-constraint query\nvia lsst.sphgeom.Region directly. It is useful in template search.\n\nIn the new query system, query_datasets can take only one\ndatasetType at a time.  In the old system, butler.registry.queryDatasets\ntake a list of dataset types.\nSo now we need to query for one type of calibs/refcats at a time and\ncall _filter_datasets for each.\nDifferent calibs have different validity ranges.\nFor a criteria, it's possible to get some calib but not some others.\nBecause it now calls _filter_datasets for one calib type at a time,\n_MissingDatasetError is expected for some types.\n\nTODO:\nremove the unneeded goodSeeingCoadd in the test/data/central_repo ?\n\nNote: The old query system is still used in other places.","shortMessageHtmlLink":"Use the new Butler query system in _filter_datasets"}},{"before":"41246a4dc3f6abc999018a6556808a299e4acec3","after":"0b64d8ec271bde518858d4a78dcd360643e6f4cb","ref":"refs/heads/tickets/DM-43712","pushedAt":"2024-09-20T21:48:14.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"hsinfang","name":"hsinfang","path":"/hsinfang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13244058?s=80&v=4"},"commit":{"message":"Use the new Butler query system in _filter_datasets\n\nThe new Butler query systems supports spatial-constraint query\nvia lsst.sphgeom.Region directly. It is useful in template search.\n\nIn the new query system, query_datasets can take only one\ndatasetType at a time.  In the old system, butler.registry.queryDatasets\ntake a list of dataset types.\nSo now we need to query for one type of calibs/refcats at a time and\ncall _filter_datasets for each.\nDifferent calibs have different validity ranges.\nFor a criteria, it's possible to get some calib but not some others.\nBecause it now calls _filter_datasets for one calib type at a time,\n_MissingDatasetError is expected for some types.\n\nTODO:\nremove the unneeded goodSeeingCoadd in the test/data/central_repo ?\n\nNote: The old query system is still used in other places.","shortMessageHtmlLink":"Use the new Butler query system in _filter_datasets"}},{"before":"350bebe837939086ddffc96c008fde953a45df69","after":"0e282609c517e58cee5ad44fbbfc1a584f45ce0c","ref":"refs/heads/tickets/DM-43082","pushedAt":"2024-09-20T19:13:54.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dspeck1","name":null,"path":"/dspeck1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16627351?s=80&v=4"},"commit":{"message":"Fix type error for topic.","shortMessageHtmlLink":"Fix type error for topic."}},{"before":"321b261405477a39e3f3063874bb398e8f48bc12","after":"350bebe837939086ddffc96c008fde953a45df69","ref":"refs/heads/tickets/DM-43082","pushedAt":"2024-09-20T18:56:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dspeck1","name":null,"path":"/dspeck1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16627351?s=80&v=4"},"commit":{"message":"Fix placement of init.","shortMessageHtmlLink":"Fix placement of init."}},{"before":"254d6456d7bcfb5b3d8e4e4bc4a9c17aa87091f3","after":"321b261405477a39e3f3063874bb398e8f48bc12","ref":"refs/heads/tickets/DM-43082","pushedAt":"2024-09-20T18:28:26.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dspeck1","name":null,"path":"/dspeck1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16627351?s=80&v=4"},"commit":{"message":"Initalize local registry for keda.  In flask this is run from config on initialization.","shortMessageHtmlLink":"Initalize local registry for keda. In flask this is run from config o…"}},{"before":"396108b1d4adccabb76fb3d29d7da74c47c32b11","after":"41246a4dc3f6abc999018a6556808a299e4acec3","ref":"refs/heads/tickets/DM-43712","pushedAt":"2024-09-19T23:31:53.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"hsinfang","name":"hsinfang","path":"/hsinfang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13244058?s=80&v=4"},"commit":{"message":"Use the new Butler query system in _filter_datasets\n\nThe new Butler query systems supports spatial-constraint query\nvia lsst.sphgeom.Region directly. It can be used in template search.\n\nIn the new query system, query_datasets can take only one\ndatasetType at a time.  In the old system, butler.registry.queryDatasets\ntake a list of dataset types.\n\nDo one type of calibs at a time, and call _filter_datasets for each.\nDifferent calibs have different validity ranges.\nFor a criteria, it's possible to get some calib but not some others.\nBecause it now calls _filter_datasets for one calib type at a time,\n_MissingDatasetError is expected for some types.\n\nTODO:\nremove the unneeded goodSeeingCoadd in the test/data/central_repo ?\n\nNote: The old query system is still used in other places.","shortMessageHtmlLink":"Use the new Butler query system in _filter_datasets"}},{"before":"2154049fcd2a80976d4a9da092b1289801c49b61","after":"396108b1d4adccabb76fb3d29d7da74c47c32b11","ref":"refs/heads/tickets/DM-43712","pushedAt":"2024-09-19T23:12:21.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"hsinfang","name":"hsinfang","path":"/hsinfang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13244058?s=80&v=4"},"commit":{"message":"Use the new Butler query system in _filter_datasets\n\nThe new Butler query systems supports spatial-constraint query\nvia lsst.sphgeom.Region directly. It can be used in template search.\n\nPull time_this out of the try-except block\n\nThe new Butler query system raises on empty results by default.\nexplain=False so to not raise EmptyQueryResultError.\n(still?) It leads to\nERROR-level time_this logs. This condition happens often in PP,\nsuch as searching in a newly created, empty local repo.\nERROR-level logs from this case are confusing as they are not\nreally errors.\n\nIn the new query system, query_datasets can take only one\ndatasetType at a time.  In the old system, butler.registry.queryDatasets\ntake a list of dataset types.\n\nDo one type of calibs at a time, and call _filter_datasets for each.\nDifferent calibs have different validity ranges.\nFor a criteria, it's possible to get some calib but not some others.\nBecause it now calls _filter_datasets for one calib type at a time,\n_MissingDatasetError is expected for some types.\n\nTODO:\nremove the unneeded goodSeeingCoadd in the test/data/central_repo ?\n\nNote: The old query system is still used in other places.","shortMessageHtmlLink":"Use the new Butler query system in _filter_datasets"}},{"before":"382d2a76a7cc9de4f975a8cc3fe6d20cde4355d0","after":"2154049fcd2a80976d4a9da092b1289801c49b61","ref":"refs/heads/tickets/DM-43712","pushedAt":"2024-09-19T20:56:37.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"hsinfang","name":"hsinfang","path":"/hsinfang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13244058?s=80&v=4"},"commit":{"message":"[TBS] Remove _count_by_type that is no longer used","shortMessageHtmlLink":"[TBS] Remove _count_by_type that is no longer used"}},{"before":"566e1a68e66c14e2c60c4f5a3784d4bd61b34a8f","after":null,"ref":"refs/heads/tickets/DM-45199","pushedAt":"2024-09-18T00:45:38.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"}},{"before":"4904cbd5c350ebe964cb34bd645285de8dbb8905","after":"2519bfff89de0d8d7f17840a215360162e587441","ref":"refs/heads/main","pushedAt":"2024-09-18T00:45:37.000Z","pushType":"push","commitsCount":14,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"},"commit":{"message":"Merge branch 'tickets/DM-45199'","shortMessageHtmlLink":"Merge branch 'tickets/DM-45199'"}},{"before":"becc9359f9be9498850ea724cc247bc5647499a5","after":"382d2a76a7cc9de4f975a8cc3fe6d20cde4355d0","ref":"refs/heads/tickets/DM-43712","pushedAt":"2024-09-17T23:41:56.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"hsinfang","name":"hsinfang","path":"/hsinfang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13244058?s=80&v=4"},"commit":{"message":"Update with the test data changes\n\nThis should have been together with https://github.com/lsst-dm/prompt_processing/commit/674a4b1ff63a590ea30b547bf048d34f53d57e18\n\nUnlike the old DECam test dataset, the LSSTComCamSim data of this\nnew test dataset do not have crosstalk. Use another dataset type\nto test.","shortMessageHtmlLink":"Update with the test data changes"}},{"before":"e0020f2ea4384ae5f6a8726573c3ef73b42a82e3","after":"566e1a68e66c14e2c60c4f5a3784d4bd61b34a8f","ref":"refs/heads/tickets/DM-45199","pushedAt":"2024-09-17T23:21:11.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"},"commit":{"message":"Support multiple workers per pod.\n\nThe WORKER_COUNT environment variable now lets the service\nconfiguration request multiple workers per pod.","shortMessageHtmlLink":"Support multiple workers per pod."}},{"before":"27d5ba718564bbaf12e64dd6cd8074054ad201c7","after":"becc9359f9be9498850ea724cc247bc5647499a5","ref":"refs/heads/tickets/DM-43712","pushedAt":"2024-09-17T20:43:42.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"hsinfang","name":"hsinfang","path":"/hsinfang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13244058?s=80&v=4"},"commit":{"message":"[TBS] switch to use new query system by default in _filter_datasets\n\nUpdate the unit test for this switch\n\nRemove unittest.expectedFailure when using the new system\n\nswitch skymap , ml, refcat\n\nnotes:\nIn the new query system, query_datasets can take only one\ndatasetType at a time.  In the old system, butler.registry.queryDatasets\ntake a list of dataset types.\n\nTODO:\nremove the unneeded goodSeeingCoadd in the test/data/central_repo ?","shortMessageHtmlLink":"[TBS] switch to use new query system by default in _filter_datasets"}},{"before":"fdb142ce345710b4a07e1a81b5250e7ff8b5caf2","after":"254d6456d7bcfb5b3d8e4e4bc4a9c17aa87091f3","ref":"refs/heads/tickets/DM-43082","pushedAt":"2024-09-17T16:11:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dspeck1","name":null,"path":"/dspeck1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16627351?s=80&v=4"},"commit":{"message":"Add topic and initialization","shortMessageHtmlLink":"Add topic and initialization"}},{"before":"e7aa9977f622835678e210b56a8fb07846bc165e","after":null,"ref":"refs/heads/tickets/DM-46312","pushedAt":"2024-09-16T23:34:12.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"}},{"before":"84272c3d2da53f62e37d25d48ace421edc731f6b","after":"4904cbd5c350ebe964cb34bd645285de8dbb8905","ref":"refs/heads/main","pushedAt":"2024-09-16T23:34:11.000Z","pushType":"push","commitsCount":6,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"},"commit":{"message":"Merge branch 'tickets/DM-46312'","shortMessageHtmlLink":"Merge branch 'tickets/DM-46312'"}},{"before":"ac53e31eaa9ddd0f9d60fe4e47cca59b2e5ee2e1","after":"e7aa9977f622835678e210b56a8fb07846bc165e","ref":"refs/heads/tickets/DM-46312","pushedAt":"2024-09-16T22:09:28.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"},"commit":{"message":"Enforce Butler dimensions-config in make_central_repo.sh.","shortMessageHtmlLink":"Enforce Butler dimensions-config in make_central_repo.sh."}},{"before":"2e770c0d706e8152c3dd8b21fc58ff128447092d","after":"ac53e31eaa9ddd0f9d60fe4e47cca59b2e5ee2e1","ref":"refs/heads/tickets/DM-46312","pushedAt":"2024-09-16T22:01:50.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"},"commit":{"message":"Use real preprocessing pipeline in unit tests.\n\nTests previously used a mock pipeline because no preprocessing tasks\nhad been implemented, and empty pipelines are invalid.","shortMessageHtmlLink":"Use real preprocessing pipeline in unit tests."}},{"before":"4687c0b97613088d99f90a3ddc56f7871c379d3d","after":"2e770c0d706e8152c3dd8b21fc58ff128447092d","ref":"refs/heads/tickets/DM-46312","pushedAt":"2024-09-16T20:18:22.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"},"commit":{"message":"Use real preprocessing pipeline in unit tests.\n\nTests previously used a mock pipeline because no preprocessing tasks\nhad been implemented, and empty pipelines are invalid.","shortMessageHtmlLink":"Use real preprocessing pipeline in unit tests."}},{"before":null,"after":"4687c0b97613088d99f90a3ddc56f7871c379d3d","ref":"refs/heads/tickets/DM-46312","pushedAt":"2024-09-16T19:20:48.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"},"commit":{"message":"DO NOT MERGE\n\nCheck for compatibility with both old and new builds.","shortMessageHtmlLink":"DO NOT MERGE"}},{"before":"ea13c3828fc0e7b6feff666fd1c739bd616d28a9","after":"fdb142ce345710b4a07e1a81b5250e7ff8b5caf2","ref":"refs/heads/tickets/DM-43082","pushedAt":"2024-09-16T17:21:11.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dspeck1","name":null,"path":"/dspeck1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16627351?s=80&v=4"},"commit":{"message":"fix formatting issues","shortMessageHtmlLink":"fix formatting issues"}},{"before":"3a43d271d02994d18e66f1978b558ee942bf8cb9","after":"ea13c3828fc0e7b6feff666fd1c739bd616d28a9","ref":"refs/heads/tickets/DM-43082","pushedAt":"2024-09-16T17:04:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dspeck1","name":null,"path":"/dspeck1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16627351?s=80&v=4"},"commit":{"message":"fix missing colons","shortMessageHtmlLink":"fix missing colons"}},{"before":"3a09055208f7736c756a2dce1fd3c787245c86c0","after":"3a43d271d02994d18e66f1978b558ee942bf8cb9","ref":"refs/heads/tickets/DM-43082","pushedAt":"2024-09-16T15:45:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dspeck1","name":null,"path":"/dspeck1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16627351?s=80&v=4"},"commit":{"message":"Add missing closing parentheses.","shortMessageHtmlLink":"Add missing closing parentheses."}},{"before":null,"after":"3a09055208f7736c756a2dce1fd3c787245c86c0","ref":"refs/heads/tickets/DM-43082","pushedAt":"2024-09-16T15:37:50.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dspeck1","name":null,"path":"/dspeck1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16627351?s=80&v=4"},"commit":{"message":"Initial commit.   Add platform selection, start, and fan out kafka consumer.  Update CI to build for this branch for testing.","shortMessageHtmlLink":"Initial commit. Add platform selection, start, and fan out kafka cons…"}},{"before":"5a78a72cea7556e871f51d4f4ab1d47d04637ce3","after":null,"ref":"refs/heads/u/kfindeisen/dataset-type-update","pushedAt":"2024-09-13T18:08:44.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"}},{"before":"36074925a47a449fa15d6be5c779315eed3e96e0","after":"84272c3d2da53f62e37d25d48ace421edc731f6b","ref":"refs/heads/main","pushedAt":"2024-09-13T18:08:42.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"},"commit":{"message":"Merge branch 'u/kfindeisen/dataset-type-update'","shortMessageHtmlLink":"Merge branch 'u/kfindeisen/dataset-type-update'"}},{"before":null,"after":"5a78a72cea7556e871f51d4f4ab1d47d04637ce3","ref":"refs/heads/u/kfindeisen/dataset-type-update","pushedAt":"2024-09-13T16:18:13.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"kfindeisen","name":"Krzysztof Findeisen","path":"/kfindeisen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8508260?s=80&v=4"},"commit":{"message":"Update instructions for registering new dataset types.\n\nprompt_processing/ApPipe no longer works because it represents the\n\"main\" pipeline after preloading.","shortMessageHtmlLink":"Update instructions for registering new dataset types."}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0yM1QxNjoyMDowOS4wMDAwMDBazwAAAAS-Msmm","startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0yM1QxNjoyMDowOS4wMDAwMDBazwAAAAS-Msmm","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xM1QxNjoxODoxMy4wMDAwMDBazwAAAAS1riob"}},"title":"Activity · lsst-dm/prompt_processing"}