Yes, there are some grave risks associated with giving the power of attorney. You are legally entrusting the agent with all your financial matters and thus the agent must be trustworthy.