Context-Aware Authorization Framework for Agentic AI: Adaptive Access Decisions, Risk Assessment, and Trust Management
Keywords:
Agentic AI, Context-Aware Authorization, Adaptive Access Control, Risk AssessmentAbstract
Agentic artificial intelligence systems differ from conventional software applications because they can interpret objectives, invoke tools, access heterogeneous resources, and execute multi-step actions with limited human intervention. Consequently, authorization mechanisms based exclusively on static identities, predefined roles, or binary permission checks are insufficient for environments in which access requirements change according to task context, resource sensitivity, behavioral evidence, and evolving risk. This paper proposes a Context-Aware Authorization Framework for Agentic AI that combines contextual representation, adaptive risk assessment, attribute-aware decision mechanisms, and dynamic trust management. The methodological foundation is derived from the provided literature on attention modeling, attribute-specific representation learning, similarity prediction, iterative learning, and knowledge distillation. These techniques are conceptually transferred to authorization by treating an agent's request as a multidimensional representation rather than as an isolated identity-permission pair. The framework introduces a context aggregation layer, risk evaluation engine, policy decision mechanism, and continuous trust monitor. A conceptual evaluation demonstrates how increasingly fine-grained contextual information can improve authorization discrimination while introducing computational and governance trade-offs. The resulting framework provides a structured approach for risk-adaptive authorization in agentic environments, particularly where agents operate across heterogeneous tools and dynamically changing operational contexts.
Downloads
References
1. K. Ak, J. Lim, J. Tham, and A. Kassim, “Efficient multi-attribute similarity learning towards attribute-based fashion search,” in Proc. IEEE/CVF Winter Conf. Appl. Comput. Vis. (WACV), 2018, pp. 1671–1679.
2. J. Dong, “Fine-grained fashion similarity prediction by attribute-specific embedding learning,” IEEE Trans. Image Process., vol. 30, pp. 8410–8425, 2021.
3. S. Goenka, “FashionVLP: Vision language transformer for fashion retrieval with feedback,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2022, pp. 14105–14115.
4. X. Ji, W. Wang, M. Zhang, and Y. Yang, “Cross-domain image retrieval with attention modeling,” in Proc. ACM Int. Conf. Multimedia (ACMMM), 2017, pp. 1654–1662.
5. S. Li, “COCAS+: Large-scale clothes-changing person re-identification with clothes templates,” IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 4, pp. 1839–1853, Apr. 2023.
6. Z. Liu, P. Luo, S. Qiu, X. Wang, and X. Tang, “DeepFashion: Powering robust clothes recognition and retrieval with rich annotations,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2016, pp. 1096–1104.
7. Z. Ma, “Fine-grained fashion similarity learning by attribute-specific embedding network,” in Proc. AAAI Conf. Artif. Intell. (AAAI), vol. 34, no. 7, 2020, pp. 11741–11748.
8. D. Song, J. Zeng, M. Liu, X. Li, and A. Liu, “Fashion customization: Image generation based on editing clue,” IEEE Trans. Circuits Syst. Video Technol., vol. 34, no. 6, pp. 4434–4444, Jun. 2024.
9. H. Su, P. Wang, L. Liu, H. Li, Z. Li, and Y. Zhang, “Where to look and how to describe: Fashion image retrieval with an attentional heterogeneous bilinear network,” IEEE Trans. Circuits Syst. Video Technol., vol. 31, no. 8, pp. 3254–3265, Aug. 2021.
10. Y. Tang, L. Zhang, Y. Yuan, and Z. Chen, “Describe fashion products via local sparse self-attention mechanism and attribute-based re-sampling strategy,” IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 7, pp. 3409–3424, Jul. 2023.
11. A. Veit, S. Belongie, and T. Karaletsos, “Conditional similarity networks,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2017, pp. 830–838.
12. Y. Wan, K. Yan, C. Yan, and B. Zhang, “Learning attribute-guided fashion similarity with spatial and channel attention,” J. Exp. Theor. Artif. Intell., vol. 36, no. 5, pp. 703–719, 2022.
13. L. Xiao and T. Yamasaki, “Boosting fine-grained fashion retrieval with relational knowledge distillation,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRWS), 2024, pp. 8229–8234.
14. L. Xiao, X. Zhang, and T. Yamasaki, “Learning fashion compatibility with color distortion prediction,” in Proc. IEEE 6th Int. Conf. Multimedia Inf. Process. Retrieval (MIPR), 2023, pp. 81–84.
15. L. Xiao and T. Yamasaki, “SAT: Self-adaptive training for fashion compatibility prediction,” in Proc. IEEE Int. Conf. Image Process. (ICIP), 2022, pp. 2431–2435.
16. C. Yan, K. Yan, Y. Zhang, Y. Wan, and D. Zhu, “Attribute-guided fashion image retrieval by iterative similarity learning,” in Proc. IEEE Int. Conf. Multimedia Expo (ICME), 2022, pp. 1–6.
17. S. Zhang, Z. Song, X. Cao, H. Zhang, and J. Zhou, “Task-aware attention model for clothing attribute prediction,” IEEE Trans. Circuits Syst. Video Technol., vol. 30, no. 4, pp. 1051–1064, Apr. 2020.
18. B. Bhushan, K. Pappu, V. Jadav and N. Jaiswal, "Risk-Adaptive Authorization for Agentic AI Systems," SoutheastCon 2026, Huntsville, AL, USA, 2026, pp. 1-6, doi: 10.1109/SoutheastCon63549.2026.11476129
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Minh Anh Nguyen, Quang Huy Tran (Author)

This work is licensed under a Creative Commons Attribution 4.0 International License.
All articles published by The Parthenon Frontiers and its associated journals are distributed under the terms of the Creative Commons Attribution (CC BY 4.0) International License unless otherwise stated.
Authors retain full copyright of their published work. By submitting their manuscript, authors agree to grant The Parthenon Frontiers a non-exclusive license to publish, archive, and distribute the article worldwide. Authors are free to:
-
Share their article on personal websites, institutional repositories, or social media platforms.
-
Reuse their content in future works, presentations, or educational materials, provided proper citation of the original publication.