Is that possible to use useImperativeHandle without forwardRef?

No. useImperativeHandle only works when the component is wrapped in forwardRef. It's the combination that allows parent components to use a ref on a function component.