Black screen with mouse pointer

[heihar]

Hello Linux Lite friends.

I have this weird problem that keeps bugging me. When start my machine it sometimes just shows me a black screen with a mouse pointer
I can fix it but its a lot of hassle.

This is what i need to do to fix the problem:
press ctrl-alt-F1
login at command prompt.
sudo stop lightdm
startxfce4
then im back at the desktop, i reboot.
Now in some cases this will fix it, how ever sometimes it doesn't.

If it did fix it i do:
ctrl-atl-F1
login at prompt.
sudo stop lightdm
remove my xfce config.(rm -rf ~/.config/xfce4)
startxfce4
That wil show me my desktop again. I reboot.

After startup:
Then i do a restore of a backup i made, this fixes most all my settings except for the panels.

Can any one tell me where to look for the problem? Why are my xfce settings causing problems?
I have the following running:
conky, shiki theme, cpu-graph plugin, weather plugin.

My hardware:
Asrock
Linux Lite 2.6
Desktop:  Xfce 4.10
Processor:    Intel® Atom™ CPU 330 @ 1.60GHz
Architecture:  x86_64
Memory:  1749 MB (Used: 565 MB 32.3%)
Kernel:  Linux 3.13.0-62-generic
Software Updates:  Last updated on 2015-10-14 time to update

Devices

Graphics Card:    NVIDIA Corporation ION VGA
Sound Card:    NVIDIA Corporation MCP79 High Definition Audio
Storage:  292 GB (Used: 4,4 GB)