Leaving this for future reference. I reset all settings back to factory in the VESC Tool, re-ran the FOC detection but selected a smaller motor size, left everything else default. Then set up the input after that. Did the trick.
Soft/Firmware: VESC Firmware 5.1 Hardware 4.10 Flipsky Mini FSESC4.20 50A SK8-ESC
Motor: Flipsky 6354 190KV 2450W BLDC Brushless Belt Sensored Motor. Also connected hall sensor in addition to A1 B1 C1.
Error: "Detection Failed. Reason: Flux linkage detection failed"
I ran the setup tool first and was able to control the motor before running the FOC detect. Ran FOC detection Wizard and it made a high pitched whine/screech, followed by vibrations (but no rotation) that increased in frequency followed by the Error:
"Detection Failed. Reason: Flux linkage detection failed"
In the FOC wizard I chose "Medium Outrunner" which roughly matches the 6354. Now when I go back to control it like I could before I ran the tool it vibrates but won't spin the motor anymore.
Ideas? I want to buy another motor but I don't want to fry another one if I'm doing something wrong. Thanks Kirk.