Trance-0/NoteNextra-origin
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

updates

Browse Source
This commit is contained in:
Zheyuan Wu
2025-10-09 01:35:09 -05:00
parent 09702a9418
commit c9b46d320a
2 changed files with 22 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
content/CSE5519/CSE5519_B3.md
View File

@@ -1,2 +1,13 @@
# CSE5519 Advances in Computer Vision (Topic B: 2023: Vision-Language Models)
## InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
[link to paper](https://arxiv.org/pdf/2305.06500)
> [!TIP]
>
> This paper introduces InstructBLIP, a framework for a vision-language model that aligns with text instructions.
>
> It consists of three submodules: the BLIP-2 model with an image decoder, an LLM, and a query Transformer (Q-former) to bridge the two.
>
> From qualitative results, we can see some hints that the model is following the text instructions, but I wonder if this framework could also bring to the image editing and generation tasks? What might be the difficulties in migrating this framework to context-awarded image generation?

11
content/CSE5519/CSE5519_H3.md
View File

@@ -1,2 +1,13 @@
# CSE5519 Advances in Computer Vision (Topic H: 2023: Safety, Robustness, and Evaluation of CV Models)
## How to backdoor diffusion models
[link to paper](https://openaccess.thecvf.com/content/CVPR2023/papers/Chou_How_to_Backdoor_Diffusion_Models_CVPR_2023_paper.pdf )
> [!TIP]
>
> This is an interesting paper showing that it is possible to backdoor a diffusion model with high utility and high specificity at a low cost compared to per-training.
>
> I wonder how this technique could possibly be used for AI watermarking and reliably detected with other AI operations?
>
> And there are many metrics and loss functions used in this paper, I wonder what objectives they are trying to optimize, and looking for more clarification on the presentation.