feature plan

[nihui]

• block quantization tooling
• vulkan int8 block quantization
• cpu flash attention and persistent kv-cache for arm etc.
• opaque/linear kvcache layout
• arm sve infrastructure arm sve dispatch, cast packing clip sve optimization #6955
• qcom vulkan cm opt
• vulkan cm maintenance1 opt